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ABSTRACT 



A text enhancement method and apparatus for the presen- 
tation of text for improved human reading. The method 
includes extracting text specific attributes from machine 
readable text and varying the text presentation in accordance 
with the attributes. The preferred embodiment of the 
metiaod: extracts parts of speech and punctuation from a 
sentence, applies folding rules which use the parts of speech 
to determine folding points, and presents text segments each 
on a new line and having a determined horizontal displace- 
ment based on the text specific attributes. One method 
displays text over bent curves having a shape based on text 
content. Another method includes displaying relative text 
position within a hierarchy using altemating vertically and 
horizontally tiled planes. Another method supports reading 
text segments across opposed pages without waiting for 
paging. Yet another method displays text to allow reading 
firom bottom to top as though from front to back. Still 
another method displays words in colors reflecting the 
relationships between the words and the larger text segments 
of which they are apart. 

11 Claims, 27 Drawing Sheets 
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METHOD AND APPARATUS FOR 
DISPLAYING TEXT BASED UPON 
ATTRIBUTES FOUND WITHIN THE TEXT 

REFERENCE TO PRIOR APPLICAnON 

This application is a continuation in-part of co-pending 
application Scr. No. 08/693,444, filed Aug. 7, 1996. 

HELD OF THE INVENTION 

The present invention relates to computer assisted text 
presentation. More specifically, the invention relates to 
enhanced text presentation using content specific attributes 
to improve the reading experience. 

BACKGROUND OF THE INVENTION 

The purpose of reading is to make an impact on the mind 
of the reader. This is true whether the text being read 
comprises a novel or a heads-up aircraft display. Material 
presented in a non-textual medium conveys information well 
suited to human absorption beyond the corresponding, one 
dimensional text. Still pictures present object attributes such 
as colors, relative sizes, relative locations, patterns, 
groupings, and hierarchies. An object is viewed in a context. 
For example, a picture of a small object located with others 
in a corner conveys different information than the same 
object, enlarged, by itself, and in the center. Beginning 
sentences and paragraphs add contextual information by 
their location alone. Moving pictures have movement and 
temporal change as added attributes. Much information 
comes into the brain visually and through pattern recogni- 
tion. Other information comes as audio infonnation, con- 
veying information through tone, changmg inflection, and 
changing volume level. 

Computer presentation of text for human reading has 
failed to utilize much of the human brain. As a result, only 
a part of the possible bandwidth is utilized, and computer 
text presentation is often thought of as unfriendly, constant, 
mechanical, and generally lacking in some way. When given 
the choice, most people prefer to read a book in print rather 
than a book on a computer screen. Current computer text 
presentation is poor relative to a book, and even poorer 
relative to its potential. 

Some work has been done in computerized text presen- 
tation. Huanng (U.S. Pat. No. 4,880,385) discloses an opto 
mechanical speed reading device that allows viewing text 
printed on paper through a viewing window one line at a 
time, automatically advancing lines. 

Advances have been made in methods for the computer- 
ized parsing of natural language into parts of speech. 
Schabes et al. (U.S. Pat. No. 5,475,588, disclose an 
improved parsing system for creating parse trees. Black, Jr. 
et al. (U.S. Pat. No. 5,331^56) disclose a method for storing 
parts of speech information in a file along with the original 
text for improved subsequent searching of the text. Okamoto 
et al. (U.S. Pat. No. 4,661,924), and Church (U.S. Pat. No. 
5,146,405) disclose methods for disambiguating multiple- 
parts-of-spccch. Zamora et al. (U.S. Pat. No. 4,887,212), van 
Vliembergen (U.S. Pat. No. 5,068,789), Hemphill et al. 
(U.S. Pat. No, 5,083,268) disclose methods for parsing 
natural language text. AU of the above cited patents are 
herein incorporated by reference. 

Reading is a complex process and there are many factors 
that determine differences in reading performance between 
readers and even for the same reader on different occasions. 
These include innate neurophysiological conditions such as 
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dyslexia, but also age; behavioral and motivational factors; 
level of education and prior reading practice; and perceptual 
constraints. A reader may also have different reading objec- 
tives that will affect how he/she approaches the reading 

5 material. Despite all of the above, text is presented by 
computers, at worst, as one dimensional "beads on a string", 
at best, similar to the two dimensional text presented by 
books. Indeed, whether text is presented in print or on an 
electronic display matters httle because the text presentation 

10 is essentially identical. 

Examples of the constant presentation of text are numer- 
ous. Topic sentences are presented the same as other sen- 
tences in a paragraph. Technical words are presented no 
different than non technical words. Adjectives appear the 

15 same as nouns. Educationally difficult terms are presented 
the same as simple terms. The last paragraph in a chapter is 
presented the same as the first paragraph. Text is presented 
in left justified, broken lines of constant width requiring a 
jerking eye movement firom far right to far left at regular 

20 intervals. Text is broken in mid sentence, mid-phrase and 
mid-thought, applying ancient typesetting rules. Such text 
forces the eye to travel back and forth over large distances, 
mimicking a typewriter carriage. Text is advanced manually, 
broken into chunks determined by how many lines can fit on 

^ the screen. 

There are several good reasons for not placing only one 
enhanced sentence per page in a book. These reasons may 
have been inappropriately carried over into the computer 
display of text. The possibility of modifying text presenta- 
tion to enhance the reader's ability to read text by harnessing 
the power of digital manipulation appears to have been 
overlooked by those most knowledgeable in computing. 
What would be desirable is a method for displaying the 

2^ location of text with in relation to the text hierarchies within 
which the text resides. A method for displaying text on 
opposed pages which allows reading text without waiting for 
page changes would also be desirable. A text display system 
making use of the natural human ability and preference to 
move forward while viewing objects would be useful. A 
method for displaying text using quantitative color modifi- 
cation to transparently represent the cumulative relation- 
ships between larger sentence fragments and the words 
within would be desirable. 

45 In order to preserve all of the information in an author 
written text, text presentation, by definition, must system- 
atically present the sequence of words written by the author 
in an unambiguous structure. It is also desirable that the 
additional information to be depicted in enhanced text 

50 presentation for improved reading would be incorporated 
into the reqtiisite processes of text presentation itself, (i.e., 
placing diaracters against a contrasting background at vari- 
ous locations in space and time), rather than introducing 
additional symbols that require additional learning, reading 

55 and interpretation by the reader. 

SUM^4ARY OF THE INVENTION 

The present invention is directed to a text enhancement 
method and apparatus for the presentation of text for 

60 improved human reading. The invention includes extracting 
text specific attributes firom machine readable text, varying 
the text presentation in accordance with the attributes, and 
creating a three dimensional (time and reading surface) 
visual product for enhancing the reading experience. The 

65 preferred embodiment of the invention extracts attributes 
such as parts of speech firom an input sentence and displays 
that sentence in cascading text segments down and across 



03/04/2004, EAST Version: 1.4.1 



us 6,2' 

3 

the screen. The segmentation and horizontal displacement is 
determined by applying rules which utilize parts of speech, 
punctuation, and reader preferences. The color of the text 
and background can also be varied depending on the parts of 
speech and on the position of sentences within paragraphs 
and paragraphs within chapters. 

The invention adds meaningful visual attributes to 
enhance the presentation of computer displayed text above 
the constant and mechanical textual display of current 
systems, A meaningful visual cue is created ttiat relates to 
the content of the new phrase and its relationship to the 
previoxis phrase. This cue is available before the text is read, 
giving context to the text. The sentence parsing processing 
uses the sentence's punctuation and content to create a 
system of meaningful visual cues including distinct phrases 
which promotes quicker recognition of the words in a phrase 
and their meanings. The enhanced sentence cascades down 
the page in a pattem of meaningful phrases determined by 
text content and reader preferences, the eyes moving a short 
distance from phrase to phrase, 

A sentence represents a complete thought, and a para- 
graph represents a discrete subject or argument. Reading 
comprehension improves when one sentence appears at a 
time and when the transition from one paragraph to another 
is visually signalled and includes a pause for the appearance 
of these elements of text. The invention creates appropriate 
visual attributes to provide these visual signals. The visual 
attributes can include text segmentation, horizontal displace- 
ment of one line relative to another, text and background 
color, text brightness, and animation. The animation can 
include blinking and swiping, the time dependent, 
temporary, progressive brightening of elements of text, and 
the movement of text from standard to cascaded presenta- 
tion. 

In an exemplary reading session, the reader selects text to 
read, and informs the reading system the text type, e.g. a 
novel. The reading system retrieves the proper environment 
previoxisly stored for that reader reading that selected text 
type. The reader has the opportunity to edit the reading rules 
and word sets but declines. Starting at the beginning of a 
chapter, where the reader left off, text is presented, one 
sentence at a time, cascaded down and across the screen. As 
the lines di^layed are broken into meaningful text segments 
rather than arbitrarily ending at 80 characters, reading and 
comprehending an entire segment at a time is possible, with 
the resulting eye movement being from center of text 
segment to center of text segment, down and across the 
screen. The sentence background color is a function of the 
sentence position within the paragraph and the paragraph 
position within the chapter. Each of the sentences in a 
paragraph may have the same hue, but have incremental, but 
discemable changes in color saturation or darkness between 
sentences, and incremental, but discernible changes in hue 
between paragraphs. The background color thus provides 
non literal positional information, signalling the beginning 
and end of a paragraph, and the beginning and end of a 
chapter. 

Sentences are segmented according to reader approved 
rules. Each preposition folds a phrase in a predictable way, 
resulting in two text segments, each lying on a new line. The 
content of the line above effects the horizontal displacement 
of the Hne below. The same preposition folds and horizon- 
tally displaces text the same way whenever possible. As a 
result, the same preposition causes a similar pattem, long 
since familiar to the reader. Parts of speech effect the text 
color according to reader approved rules. As a result, both 
sentence structure and parts of speech are immediately 
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recognizable from pattem and color recognition, even before 
a word of text is recognized, providing visual, non-literal 
cues to the reader. 

The sentences advance at a rate using a rule previously 
5 selected by the reader. The formula is a function of the text 
type, number or words, educational level, and number of 
syllables present in the line. The advancement rate is a little 
faster than the reader^s comfortable rate, to increase com- 
prehension. A longer pause between sentence presentations 
signals a new paragraph before it appears. The reader is able 
to easily interact with the reading system, holding difficult 
sentences on the screen longer, and speeding up or slowing 
down the presentation. 

The above described exemplary reading session is 
exemplary, not limiting or exhausting the possible embodi- 
ments within the scope of the invention. 

The enhancement process exploits the fact that the ele- 
ments of text have non-literal qualities that can be used to 
produce a text presentation product in lime and in space that 
IS more meaningful and enhances the reader* s abUity to 
comprehend the literal meaning of the text to a greater 
degree than existing formats on computers or paper. The 
cascading of phrases down and across the screen imparts a 
visual corollary as to how the text might be experienced if 
heard from a live reading, without the reader having to 
25 subvocalize it. Reading such an enhanced text is almost like 
listening with the eyes, but as a total visual packet that is 
experienced almost simultaneously. 

Another aspect of the invention inchides recording actions 
of a reader performer reading a text aloud and can include 
30 the recording of speaking, hand movement, eye movement, 
head movement, and mouth movement. The actions are 
preferably recorded and mapped to corresponding words in 
the text. The text display can be varied in accordance with 
the recorded actions. The text display attributes can include 
35 text displacement, font height, font thickness, inter character 
spacing, inter-word spacing, and interline spacing. 

Another aspect of the invention displays the location of 
text relative to the text unit hierarchies within which it 
resides by varying the tiling of planes or windows. The 
windows or planes representing the various hierarchies are 
tiled as a function of the rank of the text unit within the 
hierarchy. One embodiment alternately horizontally and 
vertically tiles the window sets for the text unit hierarchies. 

Another aspect of the invention displays text on opposed 
pages such that reading of text across the opposed pages can 
occur without waiting for pagination. One method replaces 
the text content of each opposed page as the opposed page 
is read, without waiting for both opposed pages to be read. 

Yet another aspect of the invention displays text having an 
original text sequence, from bottom to top, in perspective, 
50 such that reading the text from bottom to top appears to read 
the text from front to back. One embodiment scrolls the text 
smoothly forward such that the reader seems to be moving 
forward through the text while reading the text. 

Still another aspect of the invention calculates the rela- 
ys tionship between words and the larger text segments of 
which they are apart. One embodiment begins with a sen- 
tence and repeatedly subdivides the sentence into segments 
according to the relationships between the segments and 
sub-segments. The relationship between the segments and 
60 sub segments is used to calculate a color value. The gen- 
eration or level or recursion in the segmentation algorithm is 
also used to determine the color value. The calculated color 
value is used to display the color or each word or phrase. 

g5 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a high-level flow-chart of a method utilized in 
an embodiment of the invention; 
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FIG. 2 is a table illustrating various attributes of the all such figures may of course be split into additional steps 

elements in one sentence; or merged into fewer steps and still describe the same 

FIG. 3 contains an example of enhanced text including embodiment 

cascade and right descent angles; [n step 102, the reading device is started, and passed the 
FIG. 4 presents the sentence of FIG. 3 as enhanced text ^ identification (ID) of the reader and the text file identifica- 

including cascade and right and left descent angles; ^ be read. Id a preferred embodiment, the reader ID is 

FIG. 5 illustrates step 110 in detaQ; obtained from the operating system. In another embodiment 

^ ■^^ ^ ^ j . . li- l- i_ • . r t^e reader is prompted for identification. In one 

rlO. 6 illustrates word sets estabhshmg a hierarchy of „. j. * • u * j j • j 

J r u- • * r-T^ ^ Ml r ij- ■ . embodmient, there IS but one reader of the device assumed, 

secondary folding points; FIG. 7 illustrates folding point Given the reader ID. reader specified parameters are 

locations in a sentence; . . , . , o * j- j • j . -i 

' retrieved m step 104. Parameters are discussed in detail 

FIG, 8 illustrates step 136 in detail; below. Given the text ID, the text file and text specific 

FIG. 9 illustrates the sentence of FIG. 7 presented as parameters are retrieved in step 104. In a preferred 

enhanced text; embodiment, the parameters have default values, and do not 

FIG. 10 illustrates a Presentation Interval Sampling His- require reader entry. In a most preferred embodiment, entry 

tory Map, wherein the time needed to read is a function of of reader preferred specific parameters is allowed, values 

senteace difficulty and complexity; and accepted, and the parameter values stored as in step 108. In 

FIG. 11 illustrates the sentence of FIG. 7 showing visual embodiment, the user is allowed to pull down menus 

pronunciation of emphasized syllables. containing dialog boxes, view default parameters, and 

™^ . u * -It 4 *• 1 J 1 * J • modify them using standard user interfaces including 

FIG. 12 IS a chart Illustrating lanes and slots used in ^^^^^-^^^ ^^^^ ^^^^ ^ ^^^^^^^ ^ 

calculating honzontal displacement; ^^^^^^^ embodiment, given suitable access permission, 

HG. 13 illustrates a curve suitable for text bending; modification of global parameters applying to aU readers of 

FIG. 14 illustrates rules for placement of text segments the text is also allowed. The reader is allowed to have 
upon the curve of FIG. 13 as a function of the segment head 25 parameters set for only the current text, all texts of the same 

and tail text attributes; type as the current text, or all texts read by this reader. 

FIG. 15 illustrates an intermediate result of a text bending Reader specific parameters include: viewing field dimen- 

algorithm; sions; color palette for background and text; word set inputs 

FIG. 16 illustrates several bent text segments formed over for rules; minimum phrase length; maximum line length; 

curves in accordance with FIG. 14 and FIG, 15; minimum and maximum text segment weight; descent 

HG. 17 illustrates a computer display having a book on ^Sles; horizontal displacement rule inputs; horizontal jus- 

a computer display prior to opening; UficaUon preferences; inter-phrase gap length; advancement 

T-T^ -.o -ti . . f ^ . . ... rate; inter sentence and inter paragraph interval proportions; 

. crn 1,V^ ' display showmg the book lagging definitions; animation specifications; definitions of 
of FIG. 17 after opemng, exposing the chapters within; 35 p^^^^ters to derive content dependent presentation inter- 

FTG. 19 illustrates a computer display havmg the chapters vals; definitions of parameters and weighting to derive 

of FIG. 18 after selection of a chapter, exposing the pages phrase/text matter, weight, density, complexity, and content; 

^^^^J and identities of special event scripts. 

FIG. 19 A illustrates an alternate embodiment computer 

display having the chapters of FIG. 18 after selection of a Viewing Field Dimensions 

chapter, exposing the pages within; Viewing field dimensions can specify the size of the 

FIG. 20 illustrates a computer display having the pages of window for viewing text in the two X and Y dimensions and 

FIG. 19 after selection of a page, exposing the paragraphs a third dimension, time. This field can include the entire 

within; screen or a smaller portion of the screen. The time dimension 

FIG. 21 illustrates a computer display having the para- can haclude the time over which time dependent animations 

graphs of FIG. 20 after selection of a sentence, exposing the such as blinking occur, 
sentences within; 

FIG. 22 illustrates a computer display having a cascaded 
senteace on a page selected in FIG. 21; 50 Color palette for background and text allows specification 

FIG. 23 illustrates a method for displaying text across preferred background and text color that varies with the 

multiple display pages; ^° ^ preferred embodiment, the hue and brightness of 

Ml * * ' *u *t- J r j- i • * * background color varv with both sentence position 

FIG. 24 illustrates another method for displaymg text . ^ , , , . . ..u- l . 

I J. , r J & withm a paragraph, and paragraph position withm a chapter, 

across multiple display pages; j f ? J i. j- : *i: u • t.. • . . 

^ .„ c 55 In a most preferred embodiment, the bnghtness is set at one 

FIG. 25 illustrates a method for displaymg text which level for the first sentence in a paragraph and a second level 

enables reading from front to back, from bottom to top, and the last sentence in the paragraph, with the brightness of 

which can be made to appear to move forward; g^ch sentence in between progressing from the first level to 

FIG. 26 illustrates the text of FIG. 25 after forward the second level. In a preferred embodiment, the background 

movement of the text; and hue is set at a first value for the first paragraph in a chapter 

FIG. 27 is a U-ee diagram of a sentence subdivided for and a second value for the last paragraph in a chapter, with 

color assignment and prose painting. the hue of each paragraph progressing from the first value to 

r^^r^... r.^^™,™^.. ^„ „ second value. In a most preferred embodiment, the first 

DETAILED DESCRIPTION OF THE hue is green and the second hue is violet. 



Color Palette 



PREFERRED EMBODIMENTS 

Dws a high-level flow-chart of a mei 
in an embodiment of the invention. The steps in FIG. 1 and attribute is a function of the category a word fits into. In a 



65 In preferred embodiments, text color can vary with a 
FIG. 1 shows a high-level flow-chart of a method utilized word's categorical and continuous attributes. A categorical 
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most preferred embodiment, categories include parts of 
speech e.g. verb, and technical words. Continuous attributes 
include those that can be measured such as educational level 
e.g. twelfth grade, number of syllables, and word length. In 
a preferred embodiment, different parts of speech have 5 
different text colors. In a most preferred embodiment, text 
color is varied with background color to provide optimal, 
reader preferred contrast 

Word sets can be used to specify some parts of speech. For 
example, "I" is a pronoun, "had" is a verb, "a" is an article, 
and "farm" could be a noun, verb, or adjective. The parts of 
speech need only be likely parts of speech as with the word 
"farm" which could be a noun, verb, or adjective. An 
example of the parts of speech in a single sentence is shown 
in FIG. 2. The multiple possible parts of speech column 150 ^5 
is shown as is the disambiguated part of speech column 152. 

Word sets are input in preferred embodiments utilizing 
two methods. The first method utilizes a structured text 
format such as Standard Generalized Mark Up Language 
(SGML), allowing for import and export of large word sets 
and dictionaries from diverse sources. Standard SGML 
parsers are then utilized to store the word sets in a suitable 
database. The second method allows interactive editing of 
word sets using a hierarchy of pull menus and dialog boxes. 
In a prefened embodiment, the reader specified word sets ^ 
are stored in a separate database firom the dictionary or 
glossary word sets, to allow for separate storage, editing and 
faster retrieval. 

Minimimi Text Segment Length & Maximum Line 30 
Length 

A preferred embodiment includes a reader specified mini- 
mum text segment length. A text segment is a piece of text 
that is presented on one line on a display. The minimum text 
segment length, which can be denominated in words, is the 
minimum the reader wishes to see on a separate line. A 
maximum Une length is the maximum length the reader 
wishes to see on one line. Lengths can be measured in 
number of characters, words, syllables, educational level, or 
any sum of products of these. In one embodiment, the 
minimum line length is ten characters and the maximum line 
length is thirty five characters. 

Phrase Weight 

45 

Phrase weight is a derived attribute of a phrase (text 
segment or potential text segment) giving some measure of 
the amount of material in a phrase. In one embodiment, the 
phrase weight is simply the number of words in a phrase. In 
preferred embodiment, phrase weight includes phrase den- 50 
sity and phrase complexity. Phrase density can include the 
number of technical words or number of words exceeding a 
certain grade level. Phrase complexity can include the 
number of spelling similarities between words in a phrase, 
number of ambiguous words, and total weight of reader 55 
weight specified words. 

Minimum and Maximum Text Segment Weight 

A preferred embodiment includes a reader specified mini- 
mum and maximum text segment weight. The text segment 60 
weight, is the quantity of text the reader wishes to see on a 
separate line. In preferred embodiments, the text segment 
weight is the sum of phrase weights within the text segment. 

Horizontal Justification Rules 

65 

Horizontal justification rules specify the horizontal justi- 
fication of a line of text relative to the line above. Justifi- 
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cation can include the justification type for the line or phrase 
being positioned, i.e. right, left, or center justification. 
Justification can also include the text portion of the line 
above from which the justification is measured, i.e. the entire 
line of text versus or one phrase, die point of that portion 
used, e.g. left-most, right most, or center. Horizontal justi- 
fication in one embodiment is simply measured within the 
line being positioned rather than relative to the line above. 

In a preferred embodiment, the first phrase on a line is 
center justified, measured from the center of the last phrase 
in the line immediately above. In another embodiment, the 
entire hne of text is center justified below the center of the 
line of text above. In yet another embodiment, the text 
segment "center of gravity", calculated using the difficulty 
of each word, is used as the text segment center for justifi- 
cation purposes. 

Descent Anqle 

A descent angle is the amount of horizontal displacement 
for each new hne, modifying the horizontal position called 
for by the horizontal justification rules alone. By definition, 
each text segment is presented on a new line. In a preferred 
embodiment, the descent angle is specified in units of 
characters. The descent angle and horizontal justification at 
least partially determine the "text cascade" down and across 
the screen in preferred embodiments. An example of cas- 
cading text is illustrated in FIGS. 3 and 4. A descent angle 
may be zero, meaning that, without more, the text segment 
horizontal position is determined by the horizontal justifi- 
cation rules alone. A descent angle can be left, where the hne 
below is to be shifted left relative to the hne above, or right, 
where the text shifts right. FIG. 3 illustrates only right 
descent angles. 

In one embodiment, the decent angle in a constant for 
each new line. In a preferred embodiment, the descent angle 
is a function of the text segment weight of the line above. In 
another preferred embodiment, horizontal justification rules 
call for center jxistification below the center of each line 
immediately above, and the descent angle is calculated to 
present a substantially straight path, when all text fines are 
presented, from center of line to center of line, from upper 
left to lower right on the display surface. 

In a preferred embodiment, the inputs to descent angle 
rules include attributes of the text in the line above. In one 
preferred embodiment, inputs include the reason for folding 
the line above, i.e. primary folduag point, secondary folding 
point, or collapse rule. In a preferred embodiment, a more 
positive descent angle is called for when the line immedi- 
ately above folded due to a primary folding point than a 
secondary folding point. In another prefened embodiment, 
the inputs include the text segment weight of the current hne 
and the line above. 

It is recognized that the horizontal justification rule could 
call for left justification and measuring horizontal displace- 
ment from the left margin, as weU as a zero descent angle, 
combing to result in left justified text on each Hne. 

It is also recognized that horizontal text positioning can be 
accomplished in numerous equivalent ways to the above 
example. In particular, calculations of text position can be 
accomplished by first justifying then shifting, or first shifting 
then justifying with equivalent results. 

Gap Length 

In one embodiment, gaps are associated with folding 
points whose locations have been determined, but because 
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of Other rules, remain on the same line and do not cause appearance of the next sentence. A reading event contains a 

folding. A gap of zero or more spaces is added after a folding series of reading moments. A reading moment is a freeze 

point where that folding point has failed to cause new line frame appearance of text to the eyes of the reader trying lo 

creation. To a preferred embodiment, the gap length is a comprehend the text. To many readers, the reading moment 

reader determined parameter, where a gap length of zero 5 will find the eye centered on a phrase, the phrase alone on 

results in a no gaps being created. Gaps allow a visual cue a line, the reader comprehending the single phrase, 
as to the existence of phrases even where the phrases have 

not caused new line formation. Reading Rate 

Advancement Rates Th® presentation interval is the duration of a sentence 

. , ^ , J. 1 J ^. J ^. presentation on the screen. The presentation interval may be 

Advancement rates specify display duration times and the ^ u a * *• n j * j « j 

. . , . c • r reader controlled or automatically determined. Reader con- 
time intervals between the presentation oi one grouping of . . . „U U • TIT *!. 

J,, ,T i- j . . trol m one embodiment may be via mouse clicks. In another 

text and the next. In a preferred embodiment one sentence * j * i „ u • 

, , ^ ^ r J L J- .... embodiment, reader control may be via eye movement 

IS presented on one screen. In a preferred embodiment, the ^ * ^ u- u j**-^.- 

j.*^, J , . f. • r .1 . ^, detection or bram wave change detection. Bram wave detec- 

display duration rate can be a function of the text s appro- 15 ^ , „ u * * i_ 

- .1 ■ J i_ J J 1, t tion operates by generatmg a new sentence request when the 

pnately weighted number of words, educational level, pro- . • j- * j- ^ 

^ t r t . i* It . i brain waves corresponding to reading activity change to 

nunciation time, number of phrases, number of syllables, or i ■ , -r. J^. , . t- .j j- .l 

u • u* • . 1 • 1 J .J • 1 t^rain waves associated with havmg fimshcd reading the 

phrase weight. Time mlervals can mclude the interval sentence 

between sentences and paragraphs. In a preferred „ 

embodiment, the time inteival between sentences and para- 20 ^ ^^^^ ^ measured m text content per unit of time, 

graphs is different. In this way, the constant arrival rate of ^"^^ ^^^^ ^"^^ measured in length units 

text in cunent systems can be replaced with a rate dependent ^^^^ f ^^^^^^ syllables, pronunciation time, or 

on where the text Ues and what the content of the text is. P^^iously discussed measures of phrase length or 

weight or any sum of products of these. Text Content Units 

Stations ^ may also be measured in complexity units such as those 

Stations are display surface locations at which text is Previously discussed with respect to phrase complexity or 

displayed. Stations may be identified windows within which weight or any sum of products of these. The Text Content 

text is presented or points at which text presentation begins. ^nits m a preferred embodiment are calculated for a pre- 

A preferred embodiment includes an active text station, ^^^^^^^ ^"^/^^^ ^o compare the actual reading rate 

where text being read is presented. Another preferred 30 ^ext Content Umts per time with reader controUed 

embodiment includes a pre reading station displaying about Presentation mtervals, and to set the text presentation mter- 

to be read text and a post-reading sUtion displaying already automatically controUed text presentation mtervals. 

read text. In one embodiment, the total text presented at all 1° ^^ ^^^y. the presentation mterval can be made content 

stations on the viewing surface is controUed by the expected dependent, and be made to track the likely reader preferred 

reading or pronunciation time. In one embodiment, only 35 Presentation rate, 

about one minute of material is allowed on the screen at any Special Events 

one time. ^ 

Special events are time dependent events that occur 
diu-ing the reading event. Special events include a visual or 

Animation is the time dependent presentation of text. 40 audible cue giving a time remaining signal. For example. 

Examples of animation include blinking, dissolving, and when 75% of the content dependent presentation interval has 

swiping, that is, the brightening of successive text portions elapsed, a visual cue would appear on the screen. Special 

at a specified rate. In a preferred embodiment, a modified events may be arranged by a special event script. Complex 

scroll effect is accompUshed by stacking about to be read special events include a series of special events, 
text in flat rows at a pre-reading station at the top of the 45 

screen, stacking previously read rows at a post-reading Msual Pronunciation 

station at the bottom of the screen, and cascading the active visual pronunciation involves staggering in time the color 

sentence at an acUve station across the middle of the screen. brightness changes of individual phrases, words, and 

In one embodunent, pre-reading and post reading text and/or syllables, though not necessarily all of these. One embodi- 

background colors differ ftom that of the currentty bemg so ^^^j j^^^j^ ^^^^^^^ „^ j^^^^^ ^^^^ ^^^j ^^^^ 

read text. requiring longer to pronounce by using highlighting. Msual 

Tagging pronunciation is an example of a complex special event. 

Tagging includes designating whether a sentence will be Pulling Down the Cascade 
tagged with a definition or a drawing related to the word. In 55 

a preferred embodiment, a word set specifies which words ^ embodiment, text is displayed at a pre-reading 

wiU be tagged with a definition. When a tagged word is station for a percentage of the content dependent presenta- 

sclectcd bv a reader, a definition, drawing or other electronic interval, then presented in a sentence cascade one text 

illustration of the word can be displayed. In a preferred segment or one line at a time. PulUng down the cascade is 

embodiment, a tagged word, when selected, displays a 60 ^ example of a complex fecial event, 

pop-up window containing the definition or drawing. Pre- No L* e T t 
fcrrcd methods of selection include using a mouse and right 

shift button. Linear text is text presented and read from beginning to 

Readin Event ^ designed to be read from beginning to end is a 

^ 65 common example of linear text. Non linear text includes the 

A reading event includes the appearance and disappear- presentation and reading of text in an order other than linear, 

ance of a sentence and any additional time before the One example of non-linear text is Hypertext, where certain 
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words are presented in such a way to indicate linkage e.g. the emphasis level. Identifying parts of speech with 100% 

text is angle bracketed or colored blue. Non-linear text accuracy would require extensive programming to deter- 

presentation can be both reader directed and automatic. One mine the real- world context of the text. Such accuracy is not 

example of this is automatic presentation of Hypertext in a required to practice the invention, as errors are of minor 

depth firet order, following the first Hypertext link, ignoring 5 consequence because the reader is a human, not a machine, 

cycles. Another example is a breadth first presentation. The possible parts of speech are first determined by looking 

presenting the first level of text, followed by any Hypertext ^^^^ ^ ^ dictionary or glossary. This dictionary or 

links from the main level, followed by any Hypertext links glossary need only have the likely parts of speech for a word, 

from the first level, continuing until the lowest depth is ^ defimtion. For example, the word "farm" could be a 

reached or the reader intervenes. Yet another example is lO adjective. A preferred embodiment stores the 

pruning either depth or breadth first presentation to include P^^. f "P""?^*} usmg a bitmap to preserve the 

. . jr-* . multiple possible parts of speech. One embodiment exphc- 

only porUons having certain keywords of interest. .^^ ^^^^ ^ ambiguity aitribute, indicating whether the 

Magic Reading Glass "^^^^ ^^'^ multiple possible parts of speech. Another 

embodiment uses the existence of more than a single pos- 

In one embodiment, text presentation may begin by 15 ^^^q part of speech as an ambiguity indication, 

presenting common, unformatted text. When the reader in a preferred embodiment, default parts of speech exist 

desires to see text presented as enhanced text, the reader ^ 3 dictionary and may be looked up. In a most preferred 

designates a portion of text for enhancement by placing an embodiment, a word set may be added to override or 

icon such as a "magic reading glass icon" over some part of supplement the default set. In another embodiment, techni- 

the sentence. That sentence and foUowing sentences are ^ ^al words are specified by user entered word sets, 

presented as enhanced text. This enhanced text presentation g illustrates nine word sets specifying parts of speech 

contmues until the reader deactivates the magic readmg ^ in a hierarchy. Such word sets and hierarchies are 

glass. This magic reading glass can serve as an altemate used as input to folding rules, described later. A pre- 

pomt of entry mto the enhanced text processor. ^ ^^^^^ embodiment checks the word sets illustrated in FIG. 

Method beginning with Class 1 , Subclass 1, and ending with Qass 

3, Subclass 1. Search is terminated once a word or phrase is 

In FIG. 1, step 110, the text is preprocessed. Step 110 is found. Given the limited vocabulary and static nature of the 

shown in detail in FIG. 5. The text is parsed to identify word sets in FIG. 6, a most preferred embodiment utilizes a 

paragraphs, sentences, words, and punctuation. Paragraphs fast, hand written parser to search for the words and phrases 

may be identified by blank lines, paragraph markers, inden- in FIG, 6. Preferred embodiments include parsers written in 

tation characters, lab characters, or any other suitable char- C, C++, Perl, compiled AWK, AWK and AWK to C, C with 

acteristic in the text. Sentences may be identified using regular expression functions, or any suitable language. One 

grammar rules including periods, spacing, capitahzation of parser embodiment utiUzcs YACC. 

first words, and abbreviations or the lack thereof. In a in one embodiment, the dictionary is a commerciaUy 

preferred embodiment reading well behaved text, a period, available dictionary on electronic media such CD-ROM. 

question mark, or exclamation point, either alone or fol- The standard dictionary is parsed for word attributes such as 

lowed by a period, followed by two spaces or end of parts of speech and number of syllables. As word definitions 

paragraph, signals the end of a sentence. are not needed in many embodiments, storage of numerous 

In step 124, the sentence is tokenized into words and words with associated number of syllables and parts of 

punctuation. Original author specified emphasis, e.g. italics speech is possible. In a most preferred embodiment, the 

or underlining, is preserved in preferred embodiments. A most commonly used and most recently used words are 

standard lexical scanner such as Lex (TRADEMARK) is stored in fast access memory such a solid state Random 

used in one embodiment, where the end of a word is denoted Access Memory (RAM). In embodiments where dictionaries 

in the grammar rules by white space or punctuation. Another 45 are to be hand crafted, a fast method utilizing hashing, 

embodiment utilizes a hand written lexical analyzer. One collision detection and buckets is preferred. In embodiments 

embodiment stores formatting characters such as tabs and where the word sets are fixed before reading, perfect hashing 

indents as punctuation. The location of a word is preferably without buckets is preferred. 

stored as an attribute of the word, to provide finks to, and In yet another embodiment, the level of pronimciation 

searching within, the original work. emphasis is derived as an attribute depending in part on the 

A preferred embodiment also allows groups of words to part of speech. In a most preferred embodiment, pronuncia- 

be "clamped" together, and be recognized as a group of tion emphasis is categorized as primary, secondary, and 

words. In one embodiment, such groups of words are none. In one embodiment, the pronunciation time and actual 

recognized by the lexical scanner. In another embodiment, sound, e.g. as found in a sound file, are also retrieved from 

such words are recognized by a preprocessor preceding the 55 the dictionary or glossary and stored as attributes of the 

lexical scanner to insure recognition as a phrase rather than word. 

as merely individual words. Clamped words, for example. In step 128, reader and text specific word sets are 

"Prince of Whales", would be recognized as a single phrase, searched. In a preferred embodiment, the reader specified 

and preferably not broken by the preposition into two word sets are stored in a separate database from the dictio- 

phrases displayed on two fines. 50 nary or glossary word sets, to allow for separate storage and 

In step 126, the words are looked up in dictionaries, faster retrieval. In one embodiment, reader specified word 

glossaries and tables to determine word attributes. The text sets are checked before dictionaries, and the dictionaries 

is further processed to determine categorical and continuous only checked if needed words and attributes are not found in 

attributes. In a preferred embodiment, important categorical the reader specified word sets. Preferred embodiments uti- 

attributes include parts of speech, and important continuous 65 lize a hierarchy of databases to look up words, 

attributes include word location, education level, pronim- In step 130, multiple parts of speech are disambiguated. In 

ciation time, and syllable number, location, sound, and vocal one embodiment, a microgrammar is used to determine the 
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likely parts of speech. A microgrammar utilizes adjacent or 
nearby words to more accurately determine the most likely 
part of speech for a word. For example, the word "farm" in 
the phrase "a farm in" would likely be a noun as it is 
preceded by an article and succeeded by a preposition. As 5 
another example, if a word could be either a noun or verb, 
and the word is preceded by "could", "will", "shall", or "to", 
then the word is likely a verb. If the word "farm" were 
preceded by "will", the word is likely a verb. In another 
embodiment, all disambiguation is done simply by choosing 
the statistically most likely use of the word. In yet another 
embodiment, there is no automatic disambiguation, only 
manual disambiguation using human editing. In a preferred 
embodiment, an attribute of ambiguity is stored for each 
word, indicating whether multiple possible parts of speech 
still exist after disambiguation. In yet another embodiment, 
an ambiguity attribute is not stored but derived from the 
existence of multiple possible parts of speech stored for a 
word. In one embodiment, ambiguity is inferred from the 
visual display of striped or alternating text colors associated 
with each part of speech. For example, if verbs are orange 20 
and adjectives are yellow, then a possible verb or adjective 
could have alternating yellow and orange stripes or text 
characters. 

In one embodiment of the invention, parts of speech are 
determined in part by searching for morphemes (root words) 25 
and assigning part of speech attributes based on endings e.g. 
-ly, -ing. 

In step 132, the attributes determined for the words and 
phrases are stored, creating an "enriched sentence", which 
will likely remain unchanged between readers. For example, 3Q 
the educational level and part of speech of a word wiU 
remain unchanged for different readers, even though they 
may desire different text segment lengths and presentations 
rates. In one embodiment, the enriched sentence is stored in 
persistent storage such as a file. In another embodiment, the 35 
enriched text is stored on CD — ^ROM. In a preferred 
embodiment, the enriched sentence is implemented as a 
linked list of nodes, each node having the word and phrase 
attributes described above including the position of the word 
in the original text. 

In FIG. 5, step 134, primary folding points are determined 
by applying primary folding point mles. Folding points are 
text dividing points located between letters. In a preferred 
embodiment, folding points are classified as primary and 
secondary. Primary folding points are determined using 45 
primary folding rules which determine primary folding point 
locations based on ptmctualion marks. FIG. 7 illustrates a 
primary folding point after the comma following "Africa". 
Primary folding points divide text into "Super-phrases". In 
a preferred embodiment, primary folding points are located 50 
at every comma, colon, semi-colon, and left parenthesis, 
brace, and curly bracket. The folding point location can be 
stored as an attribute in a node in a linked list of nodes 
forming the eruiched sentence. 

Secondary folding points arc determined applying sec- ss 
ondary folding point rules. In preferred embodiments, sec- 
ondary folding points and rules are ranked in a hierarchy and 
secondary folding rules accept parts of speech as inputs. In 
a most preferred embodiment, secondary folding rules 
include as rule inputs attributes of the text content of the text 60 
segments and phrases being processed. For example, a 
secondary folding point may be called for by a segment of 
text exceeding a reader preferred maximum text segment 
weight even though a maximum text segment length has not 
been reached. 65 

Continuous attributes such as phrase difficulty, density, 
complexity, power and pronunciation time may be used as 
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inputs to a rule modifying the ranking established by a table 
such as that of FIG. 6, using parts of speech alone to 
determine secondary folding part raiddngs. For example, a 
segment of text having a weight greater than 35 percent 
above the text average would have a Class rank of 1 assigned 
regardless of the rank otherwise called for by the table of 
FIG. 6. In one preferred embodiment, phrase weight or 
power is used exclusively to determine secondary folding 
point rankings, rather than solely parts of speech. 

In an altemate embodiment, folding rules call for folding 
based on the nimiber of characters on the Mne, and the parts 
of speech are displayed using colors corresponding to a 
word's part of speech. The later embodiment may not offer 
the advantages of cascading, but does offer visual display 
cues based on text content. 

FIG. 6 illustrates a table used in a preferred embodiment 
to determine secondary folding points. For example, prepo- 
sitions determine Class 3, Subclass 1, secondary folding 
points. In FIG. 7, there arc class 3 secondary folding points 
before the prepositions "in" and "of. Secondary folding 
points divide Super-phrases into "Mini-phrases", as illus- 
trated in FIG. 7. Mini phrases are related to text segments in 
that Mini-phrases are often the same as text segments and 
are often displayed each on a new line. Once Mini-phrases 
are identified however, rules may dictate that more or less 
than one Mini-phrase appear as a text segment on a line. 

Primary folding rules are applied first, followed by sec- 
ondary folding mles, applied in order of the folding rule 
rank. An example of secondary folding rule ranking is 
shown in FIG. 6, established by the ranking of the word sets 
giving rise to the secondary folding points. Some prefeaed 
embodiments use either phrase weight or power to deter- 
mine secondary folding point rank rather than solely using 
parts of speech. A most preferred embodiment allows reader 
entry of a preference for parts of speech or phrase weight/ 
power determination of secondary folding point ranking. 
Some readers prefer text segmentation based on structure, 
while others prefer text segmentation based on complexity 
or estimated time to read a text segment. 

In a preferred embodiment, secondary folding rules are 
appUed only tmtil a limit is reached. This limit is often the 
minimum line length. One method of determining the loca- 
tion of secondary folding points is shown in FIG. 5, step 136, 
and in detail in FIG. 8, step 136. In one embodiment, where 
the application of a secondary folding mlc to a Super-phrase 
would result in a Mini phrase length less than the minimum 
specified line length, the folding rule is not appUed and no 
further folding mles are applied to that Super phrase. 
Conversely, when no folding point would otherwise exist in 
a fine exceeding the maximum line length, a coUapse rule is 
applied, forcing the folding of the text into two lines. When 
all Super-phrases are to have no further folding rules 
applied, the folding process is complete. 

In FIG. 1, step 111, the parameters, attributes, and folding 
mles can be used as input to the horizontal displacement 
mles. The horizontal displacement rules determine the hori- 
zontal location of the text segment. In a preferred 
embodiment, horizontal displacement mles include both 
horizontal justification rules and descent angle mles. Hori- 
zontal displacement in this embodiment is the sum of the 
results from the horizontal justification rule and the descent 
angle rule. In an easy to implement embodiment, the hori- 
zontal displacement rule is simply the descent angle as 
applied to the center justified text segment. Such an embodi- 
ment does not utilize the folding mle terminating the pre- 
ceding text segment as input and provides minimum eye 
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movement while reading the sentence cascade. Another in "Ngong", and has initial color/highlight 208, followed by 

embodiment adds left descent for preceding Class 1 folding color/highlight 209. 

points, and right descent for preceding Class 3 folding The preferred embodiment depicted in FIG. 1 allows the 

points. A preferred embodiment allows reader specified enriched text from step 132 and enhanced text from step 113 
addiuonal right or left displacement for folding poinU, 5 to be edited. In a preferred embodiment, a word pointing 

mcludmg reader entered values for primary folding points, device such as a mouse is used to select a portion of text to 

and each class and subclass of secondary folding points. One be edited. The enriched sentence corresponding to that 

embodiment stores the added displacement in a table m units portion of enhanced text is internally selected, and the 

of characters. With the horizontal displacement determined, attributes made avaHable for editing. This may be imple- 
presenting the text remams. lo mented using pull down menus allowing each attribute of 

In the example of FIG. 9, Super phrase 1, "I had a farm the enriched text and enhanced text to be edited. Where edits 

in Africa" is divided from Super-phrase 2, "at the foot of the to the enriched text could efifect presentation, the text is 

Ngong Hills.", by the primary folding point after the comma. preprocessed according to step 110 again. In the edit session 

Super phrase 2 is divided into two Mini phrases by the of step 114, reader annotations, either hidden or immediately 
secondary folding point before the preposition *'of' . In the 15 visible, are accepted and can be stored in the enriched and 

embodiment illustrated in FIG. 9, two miniphrases are enhanced sentences. Such annotations perform the same 

presented as the same text segment as the mini phrase "in function as hand written aotes in a book. The features 

Africa", is below the three word minimum length specified editable include parts of speech, definition, color, text, 

by the reader. The first Mini-phrase, "at the foot", in a new folding points, and horizontal displacement. 

Une is center justified below the text segment above and ^.^^^ attributes and display of this embodiment may 

right shifted by a right descent angle. The last mini phrase also be stored, in step 116, preserving the changes. In one 

of "of the Ngong Hills", is left shifted because of a hori- embodiment, only the enhanced sentences are stored. In a 

zontal displacement rule calling for left shifting when the preferred embodiment, both the enriched and enhanced text 

preceding Une terminated with a secondary rather than are stored. In preferred embodiments, some edits are 
pnmary folding point. Thus, in the FIG. 9 example, the total 25 j^corded either as reader specific or global, for presentation 

honzontal displacement is determined by a combination of to aQ readers of the text. Manual editing of the enhanced text 

the decent angle and the justification of the line. jg especiaUy useful where the same text will be viewed 

Paired punctuation marks including parentheses, braces, repeatedly by others, as with an electronic book, 

brackets, and quotation marks, serve as punctuation marks in a variation of the embodiment of FIG. 1, steps 113, 114, 

which determine primary folding point locations in a pre- and 116 are omitted, with no human intervention and no 

ferred embodiment. In one embodiment, such paired punc- immediate display. In this embodiment, enriched and 

tuation is included as an input to the horizontal displacement enhanced text is created and stored for future display. The 

rules, including horizontal justification and descent angle enhanced text can be stored in standard word processing 

rules. For example, a long multi -phrase text segment format such as Microsoft Word (TRADEMARK) or Corel 

contained within parentheses might have reduced horizontal Word Perfect (TRADEMARK) binaries. In this 

shifts and reduced vertical displacement, i.e., less line to line embodiment, the presentation software can be simple, small, 

spacing than the other text in the active display area of the and fast relative to the software required to look up words 

display surface. and analyze text. Such a presentation is a preferred embodi- 

In step tl2, the enhanced text is created. In this step, the mcnt for the mass distribution of enhanced text for reading 

codes needed to create a properly displayed text segment are as "electronic books." 

created. For example, where the reader specifications require In a related variation of the embodiment of FIG, 1, 

coloring technical words red, and the enriched text indicates enhanced text itself is retrieved in step 106, with no pre- 

a word is a technical word, an escape sequence may be processing required and no edits allowed. Such a presenta- 

created that will be interpreted by the display step as tion is also a preferred embodiment for the mass distribution 

requiring red text. Similar coding may be required for of enhanced text for reading as "electronic books", 

animation, ITie enhanced text may be stored at this point for Referring to HG, 1, step 113, the presentation of each 

later display. screen of enhanced text may be manually triggered as by a 

In step 113, the enhanced text is presented on the display mouse click, [n a preferred embodiment, the rate of presen- 
device, one text segment per newly formed hue. The 50 tation is controlled by reader specified parameters including 
enhanced text can also include the animation, background display time for the text, and inter-sentence and inter para- 
color, text color, tagging, and presentation rates discussed graph arrival times. In a most preferred embodiment, the 
above. In a preferred embodiment, the background color is Text Content is measured, and the text presentation interval 
presented as a function of the sentence and paragraph is dependent on this Text Content. In a preferred 
positions. 55 embodiment, the pronimciation time of the text is used as a 

In another embodiment, illustrated in FIG. 11, some text measure of Text Content to determine presentation interval, 

is initially presented in one color or brightness for a time In another embodiment, the phrase weights arc used to 

period, followed by presentation in a second color or bright- measure Text Content and to determine presentation inter- 

ness. In FIG. 11, the sentence is presented on three newly val. 

formed lines indicated by arrows 200, 202, and 203. Within 60 A preferred embodiment allows readers to extend the 

those lines, the text is presented all on the same line, with the presentation time for a sentence, as well as speed up and 

words of FIG. 11 shown on different lines to illustrate the slow down the presentation rate. This rate can be recorded, 

temporal change of initial text color/highUght 206 to text as can the sentence length and sentence difficulty corre- 

color^ighlight 207, and initial text coloi/highlight 208 to spending to a particular presentation mterval. FIG. 10 iUus- 
209, The "Af' text at 206 is the emphasized syllable in 65 trates an example 3-D plot, a "Presentation Interval Sam- 

" Africa", and is initially shown in color/highlight 206 for pling History Map", depicting the time needed to read a 

this reason. The "gong" text is also the emphasized syllable sentence as a function of two attributes, sentence difficulty 
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and sentence length. The time needed to read can be mea- 
sured by reader preferences or by previously mentioned eye 
movement tracking or brain wave activity. The time can then 
be correlated against two attributes as in FIG. 10, or any 
number of attributes. The presentation interval in a preferred 
embodiment is continuously adjusted to match the predicted 
required reading time. 

In yet another embodiment, most appropriate where read- 
ing rate is closely measured, the inputs to folding rules are 
varied and the resulting reading rate tracked. In an embodi- 
ment suitable for creating an optimal mass market reading 
product, inputs to folding rules are varied and reading rates 
recorded for a sample population. The inputs are varied for 
optimal reading speed and comprehension. For example, the 
importance accorded by secondary folding rules to parts of 
speech relative to phrase weight is varied for optimal 
reading speed. 

In another embodiment, reader manual editing of initial 
sentence display is analyzed for relative contribution of 
isentence structure, parts of speech, length, and complexity. 
After such an initial "tunning'' or "training" period, similar 
weightings are used in folding rules for automatic text 
enhancement. Subsequent edits may be used to further refine 
the folding rules. 

In step 118, text presentation stops when there is no more 
text or a reader request to stop. Steps 120 provides for clean 
up including final enriched and enhanced text storage, as 
well as historical storage about the reading session. 

EXAMPLE OF METHOD 

Overview of Example Method 

The present invention includes a method for text folding 
and displacement that applicant believes is an improvement 
over the method previously described under the heading 
"method" above. 

One embodiment of the present invention classifies punc- 
tuation marks as either "serial" or 'l^racketing." Serial 
punctuation marks include colon, semicolon, comma, a 
single double dash (" — '\ and the ellipse. Bracketing or 
nesting punctuation marks include quotation marks, paren- 
thetical marks, brackets (as in [ and ]), and a pair of double 
dashes. The present invention worfe best when bracketed 
segments do not start inside of one bracketed segment and 
end within another. This is normally the case. 

Segments within bracketing punctuation marks can be 
serially divided with serial punctuation marks, be further 
bracketed with iimer bracketing punctuation marks, or both. 
There is one case where two commas in a segment produce 
a kind of bracketing: the middle segment of the three new 
segments formed is "bracketed" by the other two segments. 
This is common and can distinguish a relative clause fi-om 
a nonrestrictive one. It is also the way "for instance" and 
other such phrases arc imbedded in larger phrases. Some 
bracketed text e.g. text within quotation marks, can span 
more than one sentence. 

In the method described below, bracketed segments are 
identified. The text outside of the bracketed segment is 
examined for serial punctuation marks. These are used for 
folding first. Then non bracketed text and bracketed text are 
separated with folding steps that put each type of text on 
separate rows. Bracketed text is placed on its own row, with 
the bracketing punctuation marks at the very beginning and 
end of each segment. This cycle is repeated as needed. A 
segment is ready to leave the algorithm portion dealing with 
"punctuation mark folding" and begin with "word only 
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folding" (word based folding), when it contains no ptmc- 
tuation marks other than those foimd at the beginning and 
end. Steps 1 through 15 in the algorithm below deal with 
punctuation mark folding. 

s Word only folding begins with step 16 and will fold each 
segment to fit between maximum and minimum targets. 
Folding points in the text will be specified by "hinge words." 
The hinge words can be specified by a word list. In a 
preferred eibodiment, words or phrases in the word list are 

10 associated with a classification code or code word that 
includes information about the word. In the example illus- 
trated below, the classification include a letter prefix and a 
number rank or level number. Letter prefixes include "b" 
(fold before this word, not after), "a" (reserved for future 

15 use, fold after this word), "x" (definitive subjective pronoun 
Ust), "y" (pre-determiner list), "z" (post determiner list). 
Examples of words and associated codes are contained in 
Appendix 1. 

In the example below, the level numbers range from 0 to 
^ 99. The lower level numbers have higher rank and are 
handled first by the algorithm. The variable "n" is used to 
denote this value in the steps described below. The 10-39 
range includes the before "b" hinge words. The 40-46 range 
includes verbs, including 40 (modal), 41 (have, auxiliary 
^ verbs), 42 ("to be" verbs), 43 (unambiguously transitive 
verbs), 44 (unambiguously intransitive verbs), 45 
(ambiguous transitive verbs, words not always verbs), and 
46 (ambiguous intransitive verbs, words not always verbs). 

Letter prefixes relating to verbs include "c" infinitive), 
"d" (past participle), "e" (other forms that do not take 
helping verbs), "f (can be both infinitive and past 
participle), and "g" (gerund) The verb classification is used 
in an improved verb handling method described in another 
section. 

"Lane" refers to a unit of horizontal displacement that is 
subdivided into a sub-unit of horizontal di^lacement called 
a "Slot." In a preferred embodiment, each lane is 4 spaces 
wide, subdivided into 4 slots each 1 space across. The lanes 
are numbered 1 through 5 and the slots labelled A, B, C, and 
D. In a preferred embodiment, Lane 1, slot A, begins 2 
spaces from the left margin, followed by slot B, then C, then 
D, followed by lane 2, slot A, etc. 

"X" (upper case X, denotes the generation number Le. the 
recursion level in the algorithm. For example a sentence is 
divided into a segment 1 and a segment 2, segment 2 is 
further divided into segments 2.1 and 2.2, and segment 2.1 
is further divided into segments 2.1.1 and 2.1.2. Segments 
2.1.1 and 2.1.1 are at generation 3. X is often used to 
determine the coarse horizontal displacement i.e. the lane 
number. 

The "x" (lower case x) denotes the index or ofiEsct into the 
sentence or sentence fragment at a particular word. The x is 
incremented/decremented in words, not characters. 
55 The "n" term refers to the hinge word level number. In the 
example below, the hinge word level ranges from 1 through 
99. 

Referring now to FIG. 12, a table 320 includes a header 
row 322 listing the spaces from left margin for each column 

60 below. A header column 324 contains a list of hinge word 
levels. The rows are divided into a series of lanes 328 which 
are subdivided into 4 slots each. A series of Xs, for example 
at 330, denote the location of the start of a text segment, 
given the hinge word level and lane. 

65 The Xs in the table shows the slot and lane into which a 
segment's first character will be placed as a function of the 
hinge word used to make the fold that produced the segment. 
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Each hinge word level, e.g., blO, b20, can be placed in any 
of the Lanes from Lane 2 on up. The lane used is determined 
by which generation of the sentence folding did the fold for 
the segment occur in. Then, within that lane (e.g., lane 3 for 
a third generation fold), a slot is determined by the hinge 
word level, as shown in the table. In this way, a third 
generation fold made with a b20 level word will be placed 
in Lane 3 slot B, and a third generation fold made with a b70 
word will be placed in Lane 3 slot D. 

The levels shown in the table at level b85 will have 
folding occur BOTH before AND after the word — ^in effect 
placing the word by itself on a its own line. The instructions 
on the table state where the b85 word should be placed, and 
where the segment following the b85 word should be placed. 
The criteria for a b85 word is not on the Hinge Word list, but 
instead has been defined as any word exceeding 12 charac- 
ters. As its position on the Hinge Word table implies, b85 
words are only used for folding if there are no alternatives 
higher on the list in the segment being interrogated for 
folding. It is otherwise not explicitly described in the algo- 
rithm. 

Method 

The Recursive algorithm is begun by setting Xol. Thus 
initially, the first lane will be used and the algorithm 
generation is 1. 

Punctuation Folds 

1. Other than punctuation marks (pms) that may be present 
at the very beginning or very end of a sentence/segment, are 
there any other pm's in the sentence/segment? Yes-go to step 

2. No-go to step 16. 

2. Are there bracketing punctuation marks in the sentence/ 
segment? Yes-go to step 3. No go to step 4. 

3. Are there serial punctuation marks "outside of* the 
bracketed text in this sentence/segment? (* If a sentence 
begins without a quotation mark, but has the second member 
of a pair of quotation marks later in the sentence [i.e., the 
quotation started in a previous sentence and is ending in this 
one], then the segment from the beginning of the sentence to 
the space following the second member of the pair is also a 
"bracketed" segment; a similar rule applies if a sentence 
contains the first but not the second of quotation mark pair. 
Yes-go to step 4. No-go to step 9. 

4. Are there colon/semi colons in the non bracketed text 
from step 3? Yes-go to step 5. No go to step 6. 

5. Fold the sentence/segment after each oolon/semi colon 
and place the text that follows each colon/semi-colon which 
may contain bracketed text) onto a new row and indent each 
new row at position Lane X, Slot A; then go to step 6. 

6. Are there commas in the non bradccted text? Yes go to 
step 7. No-go to step 8. 

7. Fold the sentence/segment after each comma and place 
the text that follows each comma (which may contain 
bracketed text) onto a new row; indent the new row of text 
that comes after the first comma at Lane X, Slot D; indent 
the new row of text that comes after the second comma at 
Lane X, Slot B: indent any additional rows of text that 
follow odd-nimabered commas at Lane X, slot D; indent any 
additional rows of text that follow even numbered commas 
at Lane X, Slot B. Then go to step 15. 

8. Are there any single "double dash" ( — ), or ellipse (...) 
punctuation marks in the non-bracketed text? Yes then fold 
the sentence/segment immediately before each single 
"double dash" or ellipse: place each new segment that 
contains the single "double dash" or ellipse and the text 
distal to it (which may also contain bracketed text) onto a 
new row; indent each new row at Lane X, slot C. Then go 
to step 15. 
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9. Is there any text between the very beginning of the 
sentence/segment (which itself may be a bracketing punc- 
tuation mark) and the first "intra sentence/segment" brack- 
eting punctuation mark? Yes go to step 10. No- then keep the 

5 first bracketing punctuation mark at the same position (do 
not fold or indent at this bracketing punctuation mark; for 
example a parenthetical mark could lead and conclude a 
sentence or segment but be followed immediately by a 
quotation mark these would then be left together according 
to this step); and go to step 11, 

10. Fold the sentence/segment immediately before the first 
bracketing punctuation mark (which, per step 9, does have 
text proximal to it); place this first "intra sentence/segment" 
bracketing punctuation mark and all of the text distal to it 
onto a new row; indent this new row at Lane X, Slot D, Then 
go to step 11. 

11. Is there a matching bracketing punctuation mark in the 
sentence/segment, (i.e., the second member of the bracket- 
ing pair)? Yes-go to step 12. No then the second member of 
this bracketing pair of punctuation marks is in a later 

20 sentence; go to step 15. 

12. Is there any text distal to the second member (as per step 
11) of the bracketing pair of punctuation marks? Yes-then go 
to step 13. No then the second member of the bracketing pair 
of punctuation marks is the end of this sentence/segment; go 

25 to step 15. 

13. Fold the sentence/segment immediately after this second 
member of the bracketing pair; indent the new row of text at 
position Lane X, Slot B; then go to step 14. 

14. Is there another bracketing punctuation mark in the text 
30 distal to the second member of the previous bracketing pair? 

Yes go back to step 10 and repeat steps 10-14 for this next 
bracketed segment distal to (not nested in) the previous one. 
No-go to step 15. 

15. Take each of the new segments formed in steps 1 through 
35 14, add 1 to X, and go back to step 1. Repeat folding and 

indenting instructions using Lane X+1. Repeat steps 1 
through 15 until all segments have punctuation marks 
located only at the beginning, or end, or both of each 
segment. In this way all segments are eventually sent to step 
40 16 for "word-only** folds. 
Word Only Folds 

16. Word-only folds begin with this step. For any value of 
X at step 1 where the answer is "no" and sends the segment 
to step 16, use the greater of: 2 or X for a Lane to begin the 

45 word-only folds. For example: If a sentence going through 
the cycle for the first time, (where X=l), had no punauation 
marks between its begirming and ending, and the answer to 
Step 1 was "no"; then begin word-only folds not with X 
(which equals 1) but with 2 (which is greater), i.e., in Lane 

50 2. However, if two cycles through steps 1-15 were required 
to obtain a segment ready for word only folds, then, at the 
beginning of the third cycle, where X now equals 3, and the 
answer to step one is "no", so at step 16 word only folds 
begin with Lane X-3). This will place word only folds one 

55 lane to the right of the last lane used for punctuation mark 
folds. After determining which lane a sentence/segment's 
first generation word-only fold will be made indents in, go 
to step 17. 

17. Does the sentence/segment exceed the Maximum Row 
60 Value (e.g., number of words or characters in the segment), 

or does it extend beyond the available space to the right? 
No — stop. Yes — go to step 18. 

18. Are there words in the segment that can be found in the 
Hinge Word list at level [n] (e.g., level blO when n=10)? 

65 No — go to 18 A Yes — go to step 19. 

18 A Repeat the question for Hinge Word list level [n+1] 
(e.g., level b20, then b30, etc.); if there are no words in the 



03/04/2004, EAST Version: 1.4.1 



us 6,279,017 Bl 

21 22 

segment that can be found at any level in the Hinge Word into the previously described "Improved Folding** algorithm 

List, up to n-95, then go to step 29. NB Words labelled 99, at step 18, as described below. The additional process is not 

with prefixes w, x, y, z are used in the verb loop, but are not required to practice the invention, but provides additional 

directly used as hinge words for folding. folding processing for verbs as described below, 

19. Is there more than one word in the segment at Hinge s [t is desirable for a text folding process to avoid breaking 
Word level [n] ? Yes use the first word that appears in the a string of related verbs thai should remain on one segment; 
sequence of the segment, and go to step 20. No-go to step 2 1 , 

20. Does the segment formed with the use of the word in step to have folding occur at verbs when a discrete verb phrase 
19 exceed the Minimum row value? No— then repeat the identified; as such, this does not require that a verb 
question usmg the next word in the sequence of the segment lo necessarily gets put on the beginning of a new row when 
that is in the same Hinge Word level [n]; if none of the words identified, identification of an appropriate phrase boundary 
at Hmge Level [n] produce a segment that exceeds the involving one or more verbs might result in a new row being 
Minimum row value then go back to step 18 and repeat for formed after the veih (in English,. 

[n+1]. Yes— go to step 21. It is also desirable for a text folding process: to avoid 

21. Fold the sentence at space designated by the word 15 separating the word "to" from the infinitive form (and only 
(before if prefix b, after if prefix a) or after), and place the the infinitive form) of a verb that follows it; to simHarly link, 
newly fonned segment in one of the slots m Lane X, or Lane if they precede a verb, the words "and" and "or" to verbs 
2, whichever is greater. The slot lo be used in this lane will identified for folding (all verb forms, not just the infinitive 
be detenmned by the Hmge Word level (see FIG. 12, forms) to process specific verb+preposition (or veib+ 
described below). Then go to step 22. 20 adverb) combinations as a single word so that subsequent 

22. Does the segment exceed the Maximum Row Value or folding would avoid separating these prepositions or adverbs 
extend beyond the avaHable space to the right? No-^top. fi-om the combination they belong to (e.g., "they broke_up 
Yes— then go to step 23. the fight" v. "he walked up the hiU"), and to similarly 

23. Are there are stiU levels to be checked on the Hinge Word process the "not" forms of auxHiary verbs as a single word 
List? Check up to n=95. Words in the word list having code 25 so that they may be recognized as a single word at positions 
words with n-99 e.g. w99, x99, y99, z99, are used in the relative to other verbs (e.g., "could_not go" should be 
verb loop described in a subsequent section but are not processed in the same way as "could go"). It would also be 
directly used as hinge words for folding. Yes— go to step 24. desirable for the pronoun contractions of auxiliary verbs to 
No— go to step 29. be labeled as verbs, (e.g., "you'll", "weVe", "you're"). 

24. Are there words in the segment that can be found in the 30 Verbs are complex. They can be auxiUary, modal, or 
Hinge Word list at level [n] (e.g., level blO when n=10)? ordinary in function. They may be regular or irregular in 
No-then repeat the question for Hinge Word list level [n+1]. conjugation. They may be transitive, intransitive, or either in 
If there are no words in the segment that can be found at any their ability to take an object. They may be ambiguous in 
level m the Hinge Word List, then go to step 29. Yes-go to whether they are really verbs and not other parts of speech, 
step 25. 35 Xhcy can be combined with specific prepositions or adverbs 

25. Is there more than one word in the segment at Hinge to mean something different from the verb alone. They have 
Word level [n]? Yes— use the first word that appears in the several forms which may or not be combined with auxiUary 
sequence of the segment, and go to step 26. No— go to step verbs to create various tenses and which agree with the 

person and case of the subject. 

26. Does the segment foraied with the use of the word in step 4o At the present time, it is not practical to direct cascade 
25 exceed the Minimum row value? No— then repeat the formatting using all of these variables in all their combina- 
question using the next word in the sequence of the segment tions. However, it is possible to classify verbs into four 
that is in the same Hinge Word level [n]; if none of the words major function groups (modal, have, be, and ordinary); to 
at Hinge Level [n] produce a segment that exceeds the sub classify the ordinary verbs into unambiguous v. ambigu- 
Minimum row value then go back to step 24 and repeat for 45 ous and transitive v. strictly intransitive; and, for each of 
[n+1]. Yes— go to step 27. these groups, to identify up to five different forms (infinitive. 

27. Fold the sentence at space designated by the word past participle, gerund, other, and combined infinitive-past 
(before if prefix b, after if prefix a), and place the newly participle). 

formed segment in Lane X+1, or Lane 2+1, whichever is 

greater (i.e., one Lane to the right of the one used for indents 50 Definitions for Verb Folding Method 

in the previous word-only fold generation). Does ihe seg- ^n. „ „ /, v . * • ^ 

ment formed exceed the Maximum Row Value or extend ^ (^^^^^ ^^^^) "^.^^^ ofl&et into the 

beyond the available space to the right? No-*top. Yes- or sentence fragment at a particular word. Hie x is 

then go to step 28 mcremented/decremented m words, not characters. 

28. Are there are still levels to be checked on the Hinge Word 55 "i^" ^^rm refers, in the verb loop algorithm, to the 
List? Yes— go back to step 23, and perform any possible word in text position relative to the word being investigated, 
folds using Lane X+x, or Lane 2+x, indents from the table The "n" variable does not refer to hinge word level as in the 
in HG. 12. No— go to step 29. previous algorithm 

29. "Bend" the segment into two or more newly formed 

segments so that these newly formed segments arc less than 60 n o uc ion 

Maximum Row Value and the space available to the right. For each of these function-form verb categories there are 

and place these newly formed segments in a center justified basic operations that will determine if folding should occur 

position beneath the first segment of the group. at a verb, x, (that was otherwise identified for folding by 

, ,j. r . MIN and MAX criteria). These operations look at the word 

Additional Folding for Verbs immediately before (x-1) the verb in question and determine 

This section describes an additional process for text if it belongs to a set of words specifically defined for that 

folding involving verbs in English. The added process fits function form group. Based on this, tiien the potential fold 
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is either skipped, (and the next verb in the segment that is a if one or more verbs sequentially follow x. Once a fold has 

candidate for folding at that hinge level is considered), or the been made, then the >MAX question is asked again. If more 

potential fold is kept open to consideration pending the folding is needed, then the process looks again for lower 

results of (x+1) operations. level veAs first. Ibis filters out the more elementary verb 

The content of these sets for the (x-1) operation will 5 phrases first (e.g., those beginning with a modal verb, such 

include: words that would disambiguate a verb-noun into a as "I could have bought some milk"); followed by verbs 

noun; and words that are appropriate helping verbs for the tenses involving helping verbs (e.g., ^'We have been going 

verb in question. there for several years'*); followed by unambiguous verbs; 

In a subsequent operation, a potential fold before x will be ambiguous verbs. HopefuUy, the segments will be so 

deferred if x+1 is a verb. The x+1 verb is examined to see frequently brought down to <Max using the other verb 

if the word before it (namely x) is on its list; if x is not on ^^^^^^ ^^at the steps for ambiguous verbs will not be used 

the list for x+1, then the fold is performed before x+1 rather ^ery often. By the time level 45/46 verbs are used to initiate 

than before x (because x+1 is a verb belonging to a separate ^ inquiry for folding, the higher level verbs will have all 

verb phrase). If x is on the list for the x+1 verb, (i.e.. x is a ^^^^ filtered out. This permits some useful assumptions 

helping verb for x+1), then folding is NOT performed at involving verb verb interfaces that occur between two 

x+1, and the word after x+1, (i.e., x+2), is examined. If the different 45/46 verbs. 

word after x+1 is not a verb, then the original deferred fold There are four reference lists that are used in addition to 

to occur before x is now performed. verb verb comparisons; a definite subjective pronoun list 

This process exploits the directionality of the folding (which will make an immediately subsequent ambiguous 
process: the existing folding procedure moves the inquiry of ^° verb a definite verb, denoted by x99 in the word list); a 

each potential verb from first to last in the sentence pre-determiner list (which will make a subsequent ambigu- 
sequence. If two verbs are adjacent to each other, then the veri? a definite non-verb, denoted by y99 in the word 

x-1 operation performed for the second verb in the adjacent list), a post-determiner list (which will make a preceding 

pair of verbs (an operation which looks at the fiist verb of the ambiguous verb an appropriate phrase boundary, denoted by 
pair to see if it is on a list specific for the form group of the ^ z99 in the word list); and a gerund helper verb list (which 

second verb) will determine if a fold should occur between would prevent folding in front of the gerund verb form), 

the first and second verbs. denoted by w99 in the word list. 

An x-1 operation is required for each verb, even if it is the The above algorithms for Lane and Slot assignments of 

first word beyond the MINIMUM ROW VALUE. The newly fonned segments can still be ased. The Lane, X, into 

reason for this is that it is possible the helping verbs of a which a newly formed segment is put is derived from the 

verb, X, in question were passed over in previous potential progressive folding history of a segments generational 

folds because they fell within the MINIMUM ROW "ancestors". The Slot (a,b,c,d) within each Lane, into which 

VALUE. However, by looking back toward the beginning of a newly formed segment is placed, has, up to now been a 

the segment, the x-1 operation will detect whether a helping function of the hinge word level of the word. Because all of 
verb for x did indeed precede it (even though x-1 is within words in the VERB LOOP are by definition verbs, the 

the MINIMUM ROW VALUE. In this case, the fold at x is Slot assignment would be the same, e.g.. Slot b. 
not performed. However, to try to convey the differences among the verb 

Moreover, even if x is followed by another verb in this loop folds, the Slot assignments could be modified. Any fold 
case (or any case where x-1 is a helping verb for x), this verb 40 made in the space before the inquiry verb, x, could be in Slot 

following X (at the x+1 position), will not be actively looked c. Any fold made in the space before a subsequent verb after 

for once the (x-1) operation determines that x is preceded by x (i.e., x+o), when x was followed by one or more verbs, 

a helping verb for x. Instead, the folding process — ^which is could be in slot b IF the verb at x+n was unambiguous (43 

still being driven by the fact that the segment remains or 44). Any other folds in spaces after x could be in slot d. 
>MAXIMUM ROW VALUE (because the potential fold at 45 n n, • 

X was not made)— will go to the next available verb in the Process Overview 

segment; the process will then find the verb that had just A lexicon of verbs is built. While this can be done 

been x+1, and analyze it as a new x (called x* here). The manually, the rules presented here make it possible to 

x*-l operation will now look back at the former x and automate this with an electronic dictionary. Each verb is 
determine whether x*-l is an appropriate helping verb for 50 labeled according to its function and form. 

^ • In the current hinge word list terminology, verbs would be 

The x-1 operation for level 40 verbs (modal verbs, see at a "40s level". The four function groups will therefore be: 

below), and the x-1 and x+1 operations for level 45/46 verbs modal=40; have verbs=41; be verbs=42; and ordinary 

ambiguous verbs that may be either transitive [45] or strictly verbs-43/44 and 45/46. Groups 43/44 are unambiguous 
intransitive [46]), are slightly different than those used for all 55 verbs i.e. they are always verbs. Groups 45/46 are ambigu- 

of the other verbs. In the case of modal verbs, the algorithm ous verbs i.e. they are not certain to be verbs. The odd 

was simplified because only an infinitive form of a modal number in each of these pairs represents transitive verbs; the 

verb (and there is only one modal verb that comes in even number represents strictly intransitive verbs. The verbs 

infinitive form, i.e., "do") can be preceded by another modal at either a 43 or 44 level will be looked for simultaneously 
verb (e.g., "could do"). Id the case of 45/46 level verbs, the 60 in the search for a new candidate verb for folding; once a 

typical x-1 operation is initially performed but is followed verb at either 43 or 44 is found, the x-1 operations are 

by specialized x-1 and x+1 questions. These will attempt to different for 43 versus 44. Similarly, the 45 and 46 level 

disambiguate x, and will include verb verb interfaces 00 verbs will be initially looked for simultaneously, but handled 

cither side of x. differently once identified for potential folding. 

An inquiry about a potential fold at a verb x on a lower 65 "Open" verbs, namely those not preceded by a verb, will 

level (e.g., 40), might end up with a fold being made at the be identified for potential folding as a function of the number 

space preceding a higher level verb (e.g., 46) that follows it, of the function group, as is done for the other hinge words 
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on the hinge word list. A string of sequential verbs (or 
potential verbs) could have several function word levels in 
it: "He should_jiot (40) have (41) been (42) bringing (43) 
work (43) home/* The steps outlined later will allow the 
(x-1) then (x+1) operations to continue through the string 
independent of the hinge levels of the words in the string. 

A preferred method includes five different kinds of verb 
prefix classifications, based od the form of each verb. I have 
therefore called each of these five groups: c (for infinitive 
form, e.g., "to walk", but also "I walk", etc.); d (for past 
participle form, e.g., walked); e (for other forms that do not 
take any helping verb, including: those modal verbs which 
have only this form, the third person singular form of regular 
verbs, e.g., "he walks", but also "he goes"); f (for forms that 
are both infinitive and past participle, as in some irregular 
verbs such as "to cut" and "have cut"); and, g (for gerund 
form, e.g., walking). 

Examples of how specific verbs would be labeled with 
this classification are included below. Further examples are 
contained in Appendix 1. 
Do c 40, Did c 40, Does c 40, Could e 40, 
Might e 40, Have c 41, Had d 41, Having g 41, 
Has c 41, Be c 42, Been d 42, Being g 42, Am e 42, 
Is e 42, Were e 42, 

Walk c 45, Walked d 45, Walking g 45, Walks e 45, 
Cut f 45, Cuts e 45, Done d 45, Doing g 45, 
Bring c 43, Brought d 45, Bringing g 45, Go c 45, 
Gone d 45, Going g 46, Goes e 44, Went e 44. 

Integration with Example Method Above 

The following steps 18 and 18A replace step 18 and 18A 
in the above algorithm in embodiments using the verb loop 
algorithm: 

18. Are there words in the segment that can be found in 
the Hinge Word list at level [n] (blO through b39, and b50 
through b99)? No— go to ISA. Yes go to step 19. 

Step 18A. Repeat the question for Hinge Word list level 
[n+1]. IF there are no more hinge words at level b39, then 
before going to level b50, go to the verb loop for algorithms 
involving level 40-49. After completing the verb loop for 
level 40-49, then resume folding beginning with level b50 
at step 18. If there are no words in the segment that can be 
found at any level in the Hinge Word List, then go to step 29. 

Verb Loop 

Ql. Are there any words in the segment labeled 40 through 
46 (with any letter c,d,e,f, or g before them)? 
No— go back to step 18 in the usual algorithm. 
Yes — go to step Q2. 

02. Is there a verb labeled 40 in the segment (or remaining 
segment? 

No — go to step Q20. 
Yes — go to step Q3. 

Q3. For the first (or next) 40 level verb (x) in the segment, 
is X beyond the MINIMUM ROW VALUE (>MIN)? 
No — go back to step Q2 and inspect for the next 40 level 
verb in the segment distal to x. 
Yes — go to Q4. 

Q4. Is the verb x a "c" form (i.e., is it labeled c40)? 
No — go to step Q6. 
Yes — go to step Q5. 

Q5. Is the word preceding x, (x-1) , a 40 level verb? 
No — go to step Q6. 

Yes — ^Then DO NOT fold at the space before x. Instead, go 
back to step Q2 and inspect for the next 40 level verb in the 
segment distal to x. 

Q6. There wiU POSSIBLY be a fold at the space before x, 
but there may instead be a fold before another verb at x+n. 
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Check the word(s) following x, (x+n), starting with n=l. Is 
x+n a verb (i.e., any word labeled 40, 41, 42, 43, 44, 45, or 
46, with any of the following letters before the number: c, d, 

c, f, g)? 

5 No — go to step Q6A. 
Yes — go to step Q7. 
Q6A. Is X a "c" form or an "f * form? 
No — then fold at the space before x. If the word "and" or the 
word "or** is the word before x then do not fold before x. 

10 Instead, if the "and" word or the "or" word are greater than 
the Minimum Row value, (>MIN), then fold before the word 
"and" or the word "or" . If the word "and" or the word "or" 
preceding x is less than the Minimum Row Value (<MIN), 
then do not fold instead go back to step 2 and check for verbs 

15 in the segment distal to x. 

Place the new segment in LANE X (relative to the other 
prior generations of folding firom the original segment/ 
sentence), SLOT A. Then go to step Q19. 
Yes — then go to step Q6B. 

20 Q6B. Is x-1 the word "to"? 

No — then fold at the space before x. If the word "and" or the 
word "or** is the word before x then do not fold before x. 
Instead, if the "and" word or the "or** word are greater than 
the Minimum Row value, (>MIN), then fold before the word 

25 "and** or the word "or**. If the word "and" or the word "or" 
preceding x is less than the Minimum Row Value (<MIN), 
then do not fold — instead go back to step 2 and check for 
verbs in the segment distal to x. 

Place the new segment in LANE X (relative to the other 
30 prior generations of folding from the original segment/ 
sentence SLOT C. Then go to step Q19. 
Yes — then fold at the i^ace before "to". If the word imme- 
diately before "to**, is "and** or "or", then fold before "and" 
or "or** instead of before "to". If the "and" word or the "or" 
35 word and the word "to** are all greater than the Minimum 
Row value, (>MIN), then fold before the word "and" or the 
word "or** or the word "to" , whichever is first. If the word 
"and** or the word "or** or the word "to" preceding x is less 
than the Minimum Row Value (<M1N), then do not fold — 
40 instead go back to step 2 and check for verbs in the segment 
distal to X. 

Place the new segment in LANE X (relative to the other 

prior generations of folding firom the original segment/ 

sentence, SLOT C. Then go to step Q19. 
45 Q7. Is x+n an "e" form? 

No — go to step Q7A. 

Yes — go to step Q17. 

Q7A. Is x+n a "c** form? 

No — go to step Q9. 
50 Yes — go to step Q8. 

08. Is (x+n)-l a 40 level verb? 

No — go to step Q17. 

Yes — go to step Q18. 

Q9. Is x+n an "f * form? 
55 No — go to step Qll. 

Yes — go to step QIO. 

QIO. Is (x+n)-l either a 40 ,41, or a 42 level verb? (Note, 

it is assumed that it wiH be very rare that such irregular verbs 

whose infinitive and past participle forms are the same, i.e., 
60 "f ' forms), would also be strictly intransitive, AND that a 

writer would precede the past participle of such a verb with 

a "be" verb). 

No — go to step Q17. 

Yes — go to step Q18. 
65 Qll. Is x+n any one of the following: d41, d42, d43 or d45? 

No — go to step 013. 

Yes — go to step Q12. 
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Q12. Is (x+n)-l either a 41 or a 42 level verb? Yes^go to step Q31. 

No— go to step Q17. Q31. Is (x-1) a 42 level verb OR a GERUND HELPER 

Yes— go to step Q18. VERB (w99)? 

Q13. Is x+n either of: d44 or d46? No — go to step Q33. 

No — go to step Q15. S Yes— go to step Q32. 

Yes— go to step Q14. Q32. ["Yes" to Q23, 25, 27, 29, or 31] Go to Q32A. 

Q14. Is (x+n)-l a 41 level verb? Q32A. Is x a 45 or 46 level verb? 

No— go to step Q17. No — then do NOT fold at the space before x. Instead, go 

Yes — go to step Q18. back to step Q20 and check for another verb in the segment 

Q15. Is x+n a "g"' form? lo distal to x. ^f there are no more 41 level verbs in the 

No — go to step Q17. segment, step Q20 directs inquiry to step Q34 for 42 level 

Yes — go to step Q16. verbs. Similarly, inquiry is directed from step Q34 to step 

Q16. Is (x+n)-l a 42 level verb OR a GERUND HELPER Q36 for 43/44 level verbs, and from step Q36 to step Q38 

VERB w99)? for 45/46 level verbs). 

No— go to step Q17. 15 Yes^o to step Q40. 

Yes— go to step Q18. Q33. ["yes to Q22 of "No" to Q23, 25, 27, 29, 30, or 31] Go 

017. ["yes" to Q7 or "no" to Q8, 10,12,14,15,16] Then to Q33A 

FOLD but NOT at the space before x. Instead, fold at the Q33A. Is x a 45 or 46 level verb? 

space BEFORE x+n. Place the new segment in LANE X No — then POSSIBLY fold at the space before x, but check 

(relative to the other prior generations of folding from the 20 (x+n) first. Go back to step Q6. 

original segment/sentence), SLOT B. Then go to step Q19. Yes — go to step Q42. 

Q18. ["Yes" to Q8, 10, 12, 14, 16]. Then add 1 to n and go Q34. Are there any 42 level verbs in the segment (or 

back to step Q6 using n+1 instead of n. (That is, inspect the remaining segment)? 

next word that comes after x+1 and see if it is a verb or not, No — go to step Q36, 

and proceed accordingly.) 25 Yes — go to step Q35. 

Q19. Are there still segments that exceed the MAXIMUM Q35. For the first (next) 42 level verb, x, in the segment, is 

ROW VALUE (or the space available to the right)? x beyond the MINIMUM ROW VALUE (>MIN)? 

No — stop. No — go back to step Q34 and check for the next 42 level 

Yes — go back to step Q2. verb in the segment distal to x. 

Q20. Is there a 41 level verb in the segment (or remaining 30 Yes — go to step Q22. 

segment)? Q36. Are there any 43 level verbs OR any 44 level verbs in 

No — go to step Q34. the segment (or the remaining segment)? [Note: verbs at 

Yes — go to step Q21. either level 43 or 44 are looked for at this step]? 

Q21. For the first (next) 41 level verb, (x), in the segment. No — go to step Q38, 

is X beyond the MINIMUM ROW VALUE (>MIN)? 35 Yes^go to step Q37. 

No — go back to step Q20 and check the segment for a 41 Q37, For the first (next) 43/44 level verb, x, in the segment, 

level verb distal to x. is x beyond the MINIMUM ROW VALUE (>MIN)? 

Yes — go to step Q22. No — go back to step Q36 and check for the next 43/44 level 

Q22. Is X an "e" form? verb in the segment distal to x. 

No — go to step Q22A. 40 Yes— go to step Q22. 

Yes — go to step Q33. Q38. Are there any 45 level verbs OR any 46 level verbs in 

Q22A. Is X a "c*' form? the segment or the remaining segment)? [Note: verbs at 

No — go to step Q24. either level 45 or 46 are looked for at this step]? 

Yes— go to step Q23. No— GO BACK TO THE USUAL ALGORITHMS AT 

Q23. Is (x-1) a 40 level verb? 45 STEP 18 and resume inquiry using hinge word level b50. 

No — go to step Q33. Yes— go to step Q39. 

Yes — go to step Q32. Q39. For the first (next) 45/46 level verb, x, in the segment, 

Q24. Is X an "f form? is x beyond the MINIMUM ROW VALUE (>MIN)? 

No — go to step Q26. No— go back to step Q38 and check for the next 45/46 level 

Yes — go to step Q25. 50 verb in the segment distal to x. 

025. Is (x-1) a 40, 41, or a 42 level verb? Yes— go to step Q22, 

No— go to step Q33. Q40. ["Yes" from step Q32A], Is x a 45 level verb? 

Yes — go to step Q32. No — [x is therefore a 46 level verb]. Fold at the space 

Q26. Is X any one of the following: d41, d42, d43 or d45? AFTER x. Then go to step Q19. 

No — go to step Q2S. 55 Yes— go to step Q41. 

Yes — go to step Q27. Q41. [x is a 45 level verb]. Is (x+1) a verb? [Note: by now, 

Q27. Is (x-1) a 41 or 42 level verb? if (x+1) is indeed a verb, then (x+1) shoxild be either a 45 or 

No — go to step Q33. 46 level verb] 

Yes — go to step Q32. No — then do NOT fold at the space before x. Instead, go 

Q28. Is X either one of: d44 or d46? 60 back to step Q38 and check for the next 45/46 level verb in 

No — go to step Q30. the segment distal to x. 

Yes— go to step Q29. Yes— then DO NOT FOLD at the space before x. 

Q29. Is (x-1) a 41 level verb? INSTEAD, FOLD at the space before (x+1), (which is also 

No — go to step Q33. the space AFTER x). Place the newly formed segment in 

Yes — go to step Q32. 65 LANE X (relative to the other prior generations of folding 

Q30. Is X a "g"* fonn? from the original segment/sentence), SLOT D. Then go to 

No — go to step Q32, step Q19. 
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Q42. [^'Yes" from step Q33A] Is (x+1) a verb? Additional Aspects of the Invention 
No — go to step Q43. 

Yes — then fold at the space before (x+1), which is also the Text Enhancement Using Reader Performer Actions 

space after x. Place the new segment in LANE X (relative rj. , llj - r 

to the other prior generations offoldiog from the original s ,„H?, nr'^H.f«°rf'"' ^."^anced using actions of a 

segment/sentence), SLOT D. Then go to step Q19. '"^^ performer as mpxits and a variety of audio 

nA^ 1^ ^ . f™ o« «f»» f To Visual effects as outputs. In one embodiment, a reader or 

Q43. Is X a c form or an T form? , - j*^,-..., . .. 
reader-performer reads text aloud while varying pitch, tone, 

Yes— to sic 044 volume, and pauses for effect. The term "reader performer" 

nArf f i\ *k A ^ used to distinguish over the reader of the enhanced text 
Q44. Is (x-1) the word "to ? lo j * * *l * j- i j • i j 

^ and to note that readmg aloud can include many actions m 

°, c 1? . ' u r » Tc J ■ addition to speech. The spoken text is recorded for use in 
Yes — then fold at the space before "to . If the word immc- j- i • *l * ^ t i_ j- . i . 
diately before "to", is "and- or "or", then fold before "and" displaying Uie text. In one embodiment, the spoken text is 
or "or'' instead of before "to" recorded electronically and analyzed for spoken action 
If the "and" word or the "or^' word and the word "to" are all attributes such as pitch, tone, volume, and pauses. In a 
greater than the Minimum Row value, (>MIN), then fold preferred embodiment, spoken text attributes are analyzed 
before the word "and" or the word "or*' or the word "to" , analyzed attributes are stored in addition to the 
whichever is first. If the word "and" or the word "or" or the spoken text itself. The attributes such as pitch, tone and 
word "to" preceding x is less than the minimum Row Value volume, are stored and mapped to correspond to the text 
(<MIN), then do not fold — ^instead go back to step 38 and letters, syllables and words which are also stored, such that 
check for 45/46 level verbs in the segment distal to x. ^ the attributes can be extracted and reproduced in some 
Place the new segment in LANE X (relative to the other fashion in conrespondencc with the original text. Reader- 
prior generations of folding from the original segment/ performer action attributes can be presented as display 
sentence), SLOT C. Then go to step Q19. attributes such as font, intensity, font line thickness, font 
Q45. Is (x-1) a word on the DEFINITE SUBJECTIVE character height, character color, background color, inter 
PRONOUN LIST [list x99; these words are I, we, he, she, 25 character spacing, inter-word spacing, interline spacing and 
they, who, etc.]? inter sentence spacing. 

Y^en foW the space AFTER x. Place the new . ^^^^^ «^ ^^f invention ttie volume of the reader 

segment in LANE X (relative to the other prior generations f reproduced as font intensity and the pitch is reproduced as 
of folding from the original segment/sentence, SLOT D. ao ^^^^ thickness, with higher pitches being reproduced as 

Then go to step Q19 narrower characters and lower pitohes bemg reproduced as 

Q46. Is (x-1) a word in the PRE-DETERMINER SET ^^®r characters. Font intensity can refer to the number of 

[y99]9 pixels set per unit area to a different color than the local 

No go to Q46A. background pixels. In one example, intense text is black text 

Yes — then do NOT fold at the space before x and go back 35 on white background while less intense text is gray text on 

to step Q38 to check for 45/46 level verbs in the segment white background. In another example of the invention, the 

distal to X. character color is varied in accordance with the pitch. For 

Q46A. Is X an "f , "d" or "g" form? example, higher pitched words are reproduced more toward 

No — go to step Q47. the red end of the ROYGBIV spectrum while lower pitched 

Yes— then fold at the space before x. If the word "and" or words are reproduced more toward the violet end of the 

the word "or" is the word before x, (x-1), then do not fold ROYGBIV spectrum. In another example, the text is dis- 

before x. Instead, if the "and" word or the "or" word are placed ftom the normal horizontal base line of the text in 

greater than the Minimum Row value, (>MIN), then fold accordance with the pitch of the reader-performer. One 

before the word "and" or the word "or". If the word "and" embodiment displaces text upward for higher than average 

Z f"^ Tl^L^ preceding x IS less than the Minimum Row ^tch and downward for lower than average pitch. 

Value (<MIN), then do not fold- mstead go back to step 38 45 , ^ . . - . 

and check for 45/46 level verbs in the segment distal to x. ^'^^t*^^^ example of the invention, the reader- 

Q47. Is X a 45 level verb? performer*s spacing and duration of pronunciation of spe- 

No— then do NOT fold at the space before x and go back to words is reproduced in enhanced text with spacing of 

step Q38 to check for 45/46 level verbs in the segment distal letters, words and sentences. The reader's word pronuncia- 
to x. 50 tion time and inter-word and inter sentence spacing can be 

Yes — go to step Q48. recorded, allowing normal inter word and inter sentence 

Q48. Is (x+1) a word in the POST DETERMINER SET spacing to be measured. Words pronounced more slowly 

[z99p than normal can be reproduced with additional spaces 

No — then do NOT fold at the space before x and go back to between letters of the word. Longer than normal inter word 

step Q38 to check for 45/46 level verbs in the segment distal time spaces can be reproduced using longer than normal 

to X. inter word distance spaces on the displayed text. Even longer 

Yes— then FOLD at the space BEFORE x. (If the word time spaces can be reproduced by displaying the separated 

"and" or the word "or*^ is the word before x then do not fold vvords or phrases on new lines. Extremely long time spaces 

before x Instead if the "and" word or the "or" word are ^e displayed as the separated words or phrases on new 

greater than the Minimum Row value (>MIN), then fold ^^at are vertically separated by a greater distance than 
before the word "and" or the word "or^'. If the word "and" °" normal 
or the word "or" preceding x is less than the Minimum Row 

Value (<MIN), then do not fold — instead go back to step 38 Hand Gestures 
and check for 45/46 level verbs in the segment distal to x.) 

Place the new segment in LANE X (relative to the other In another aspect of the invention, the reader-performer 
prior generations of folding from the original segment/ 65 actions recorded during reading include hand and finger 

sentence), SLOT C, Then go to step Q19. gestures. The position and orientation of the hands is pref- 

(End of Verb Loop), erably recorded and stored to correspond to each word read 
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aloud. Orientation refers to the direction pointed to by the lower pitches. The word pitch can be obtained frona a 

hands, fingers, or palms. In a two dimensional plane, the phonetic dictionary e.g. the pitch of the word can be looked 

orientation may be recorded as a two dimensional vector. In up rather than obtained from a speaker's voice. In another 

a three dimensional model, the hands may be recorded as a example, the horizontal displacement is varied in accor- 

Ihree dimensional vector. The positions may be recorded as S dance with the volume of a reader performer's voice. In one 

the position relative to the reader performer's shoulders or example, the reader-performer action is suflSciently damped 

other body reference point. so as to maintain an evenly flowing smoothly curved line. 

In selected, appropriate text selections, the vertical and 

horizontal displacement of text can be varied in accordance ^^^^ Bending 

with text content. One example of this woiild be display of lO 
the sentences "On one hand ..." and "On the other 

hand ..." The first phrase could be displaced horizontally [a spoken language, the variability in tone, pitch, and 

to the left while the second, opposing sentence could be volume fi-om one word to the next creates a signal that can 

displaced horizontally to the right. Similar, vertical displace- be thought of as a curve or trajectory. From the pronuncia- 

ments could be used to contrast hand actions such as "He 15 (j^jj of just a few words of a sentence, the beginning of such 

promised this, but delivered only this". a curve is "drawn" on an "aural chalkboard". The listener 

Hand position and orientation can be recorded using uses this initial curve to build and anticipate, in the mind, the 

known technology such as the placement of infrared reflect- structure of the phase or sentence as a whole, even before it 

ing dots at strategic locations on the hands. The reflections has been completely uttered by the speaker. 

of projected infrared lights can be captured and stored, This powerful information makes speaking listening very 

allowing later reproduction of hand movement. In another efficient. However, current text presentation technology 

method, the reader-performer uses gloved hands and the does not readily permit a system that could consistently and 

hand positions are recorded direcdy with a digital camera meaningfully depict these aural curves in graphical form, 

using the contrast of the hands against the darker back- Instead, the reader must resuscitate the elocutionary force of 

ground. ^ the sentence by decoding the symbols of the text and 

recreating an aural representation of the sentence as a whole 

Facial Expressions ^ ^^^^ 

In another aspect of the invention, facial expressions of Within a sentence, segments can be identified using 

the reader performer are recorded during reading and stored 30 content analysis that would have characteristic prosodic 

in correspondence with the words being read. One embodi- contours. The present invention describes a method to create 

ment records eye or eyelid shape, eye openness, eyebrow graphical correlates of these contours of sentence segments, 

position, head position, jaw position, and mouth shape. The and to integrate these graphical sub-units into a larger 

facial expression actions of the reader performer can be structure to depict the sentence as a whole, 

recorded on a per word basis and displayed back on a per 35 

line basis. In one embodiment, the extreme positions are ^® Process 

used to represent the position for the entire line. In another ^ Sentence segments are identified using the "sentence 

embodiment, an average posiUon is used to represent the folding" algorithms previously described. 

position for the entire line. In another embodiment, the facial ^r.^^t^- .j.^ . ^ 

expressions are used to vary the presentation of the text ^ . 2.Insteadof hor^ontal displacement niles, a set of curves 

itself. In one example, the degree of openness of the mouth j? ^^'"'^ ^S""'"' '^'S^'^ '° °^ 

tnese curves 

is used to vary the degree of openness of certain closed 

vowels, such as "0". The more the mouth of the reader- 3, The curves are then arranged on the reading field in a 

performer is open, the larger the 0 and the opening within it pattern that unambiguously depicts the sequence of the 

become. In another example, the degree of height of certain 45 segments (e.g., from top down), the position of segments 

letters such as " W' or is varied depending on the degree within these arrangements can be modified slightly, without 

of openness of the eyelids. The facial expression represen- changing the implied sequence, in order to optimize the 

tation described above is combined with text swiping pre- perception of the curves and the reading of the sentence, 

viously described in one aspect of the invention. In one Asampleof a master curve 340 which defines the size and 

embodiment, a line drawing of a human face is reproduced 50 orientation of segment curves is depicted in FIG. 13. Aseries 

above the word being swiped or highlighted. Th& facial of letters, such the letter "H" at 344, lie on c^lrve 340. An 

features on the animated face change dynamically. In arrow 342 at the top of the curve indicates the position with 

another embodiment, one face is represented beside each which a sentence segment curve that was drawn from a Head 

line of text, with the face animated as the line is swiped. Id letter (A through G) to a Tail letter (H through K) would be 

yet another embodiment, a face is presented near a phrase to 55 oriented on the reading field and relative to other sentence 

be enhanced, and a static facial expression shown on the segment curves. 

face. The Head letter position on the curve is determined by the 

^ ^ . . , ^ , X . circumstances of the beginning of the segment. The Tail 

Text Presentation Along a Curved Line j^^^^ ^^^^^^^ ^ determined by the circumstances of the end 

In another aspect of the invention, text is displayed along 60 of the segment. These circumstances are summarized in a 

a curved baseline rather than a conventional horizontal table 350 in FIG. 14. 

straight line as a function of reader-performer actions. In one After the Sentence folding algorithms have identified 

embodiment, the curved line is either invisible or substan- segments of the sentence which will occupy separate rows 

tiafly less visible than the text displaced. The curve in one (in this description, they will occupy separate curves), the 

embodiment is varied in accordance with some action of the 65 length of the segment is measured, A line is drawn that 

reader-performer. In one example, the horizontal displace- corresponds to this length. The line is then "bent" so that the 

ment of the curve is greater for higher pitches and less for shape (in degrees and orientation) of the newly formed 
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curved line conforms to the Head-Tail letter positions speci- 406. Subsequent segments are placed beneath preceding 

fied io FIGS. 13 and 14. The "dangle'* point, or the position segments by placing the "dangle point" approximately two- 

of the arrow at the top of the curve, is also identified. thirds the way across the curve above them. Additional 

The size of a segment curve is determined by its length, content-based rules could optimize these "dangle point' 

in characters; however, regardless of its length, the shape S positions. In one embodiment, the lines and Head/Tail letters 

and orientation of the segment curve will be determined by do not appear, only the characters of the text appear. A series 

the process described above. If a segment is very short, such of bent text curves generated by the example in FIG. 15 are 

that the curved segment would be too small and the curve illustrated by curves 410, 412, 414, 416, and 418. 

too extreme, a mioimum curve would be defined. Short The curves eahancc the "visual prosody** of the text 

segments with an H tail would then be placed at the Head lo presentation. Each sentence acquires an even more unique 

letter specified by their beginning circumstances-but the visual appearaaoe. The curves also break up the monotony 

remainder of the segment would follow the curvature speci- of linear presented text, which may reduce fatigue of the eye 

fied by the minimum curve path and the "dangle point" muscles, 
would also be specified by the minimum curve. Similarly, 

short segments with an I, J or K tail would be placed at the 15 Text Hierarchy Display 

Tail letter specified by their ending circumstances, and the Another aspect of the present invention provides an 

renaamder of the segment would foUow the curvature sp^^^^ improved means for displaying text hierarchies and the 

fied by the mmimum curve path and its "dangle pomt . ^^^^^^^ ^^^^ ^eing read within those hierarchies. A 

Parameters for maxmium line length would likely prevent conventional text hierarchy, listed from higher to lower rank, 

segments from being so long, i.e., have so many characters, inchides volume number, section, chapter, sub section, page, 

that their curves would be very large and relatively flat. paragraph, and sentence. The present invention provides a 

The newly formed curves would then be positioned, in method for informing the reader of both the number of the 

this example, with the first segment of the sentence on lop. units in each hierarchy and the position of the text being read 

In one embodiment, the location of the dangle point is a within that hierarchy. 

function of the next segment could be developed that was a ^ Referring to FIG. 17, an unopened book 200 is illustrated, 

function of the tail of the segment preceding it. After all of jhe book is selected for opening by the reader, as indicated 

the curves are in position, the characters of text for each ^t *'X." The reader selection can be performed using any 

segment are positioned on the curve and the lines and the method known in the art including cursor movement and 

dangle point are erased. A sample of this process is shown selection with a mouse. Referring now to FIG. 18, book 200 

m FIGS. 15 and 16. has been selected, opened and displayed as a plane 202 

New Qualities Imparted by the Text Bending fiUing a substantial portion of a display screen 201. Opening 

Process revealed a plurahty of chapters 206 each 

having an exposed margin 204. In one embodiment, the 

This text presentation method allows the reader to chapter margins have the chapter number inscribed thereon 

recognize, by a particular curve in the layout of its as indicated at 208. Reader selection of Chapter 4 is indi- 

charactecs, an individual segment's structure and function cated at "X" in FIG. 18, causing the chapters to separate at 

(not just sequential position) in the overall structure of the Chapter 4 as illustrated in FIG. 19. 

sentence. This provides graphical information that faciHtates Referring now to FIG. 19, the result of selecting Chapter 

cognitive processing of tiie sentence's segments while read- 4 niustrated. Chapters 206 are illustrated having separated 

ing. This is similar to the way the word to-word variability ^ display Chapter 4, exposing pages 210 within the chapter, 

in pitch and tone in speech creates an aural curve that helps p^gcs 210 have vertical margins 212 exposed. In one 

the Ustener predict how long a phrase is going to be and embodiment of the invention, pages are numbered and 

whether or not it wiU be the end of a sentence or clause. arranged to mirror the pages in a print edition of the book. 

Conventional text only uses punctuation marks, which are 45 In another embodiment of the invention, pages are num- 

often not discovered until the reader has already read the bercd to take advantage of the enhanced format of the text 

entire phrase-this prevents the reader from making, in the presentation, with no attempt made to mirror any print 

mind, a corresponding phonological model of what was read edition of the book. Specifically, the pages can be formatted 

until after tiie entire segment is read. The curves created by and numbered to contain only a maximum number of 

my process allow this type of phrase structure and function 50 paragraphs or a maximum number of words, whichever is 

information to be known in advance, so that this information reached first. In this embodiment, paragraphs need not be 

can be used in word recognition and phrase comprehension. broken across pages. In this embodiment, the number of 

These curves are also defined by content (i.e., hinge words) paragraphs and words in die maximum are preferably set to 

other than punctuation marks. They also further differentiate values approximating those of a normal published page. In 

segments created in the sentence folding process, by depict- 55 yet another embodiment of the invention, the number of 

ing circumstances of both the head and tail of a segment. pages in a chapter is set to a maximum, for example 50, with 

Referring now to FIG. 15, a sentence 380, the first the paragraphs evenly divided into those 50 pages. In this 

sentence of the Gettysburg Address shown in cascade form last example, at most only 50 pages are presented on the 

as generated by algorithms (Step 1 xmder "The Process" display screen. Reader selection of page 3 is indicated at "X" 

heading above). Acolumn 386 specifies a start letter 382 and 60 ^ FIG- 19, causing the pages to separate at page 3 as 

an end letter 384, for each line of the sentence. This illustrated in FIG. 20. 

determines tiie type of curve to be curve to be assigned to Referring now to FIG. 19A, the result of selecting Chapter 

each segment. 4 in FIG. 18 is illustrated in an alternate embodiment. 

An integration of these individual segment curves, from Chapters 206 are illustrated having separated to display 

Step 3, is illustrated in FIG. 16. For example, sentence 408 65 Chapter 4, exposing pages 210A within tiie chapter. Pages 

is bent over a curve 400, starting at an end position A, ending 210A have horizontal margins 212A exposed. In this 

at an end position 404, and having a dangle point denoted by embodiment, the nesting of the text hierarchies is denoted by 
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the margins having a shorter length for lower ranked hier- 
archies. In the example of FIG. 19A, pages 210A have 
margins oriented substantially parallel to Chapters 206, but 
with the margin 212Aof pages 210A having a shorter length 
than the margins of Chapters 206. 5 

Referring now to FIG. 20, the result of selecting page 3 is 
illustrated. Pages 210 have separated at page 3 to display 
paragraphs 214 within. In the initial display, only paragraph 
horizontal lower margins 216 are displayed. Reader selec- 
tion of paragraph 3 is indicated at "X'* in FIG. 20, causing 
the paragraphs to separate at paragraph 3 as illustrated in 
FIG. 21. 

Referring now to FIG. 21, the result of selecting para- 
graph 3 is illustrated. Paragraphs 214 have separated at 
paragraph 3 to reveal sentences 218 having vertical margins 
220 within. In one embodiment, the first sentence is initially 
displayed, ready for reading, as illustrated at first sentence 
222. In another embodiment, only margins 220 are initially 
displayed upon opening the paragraph. Reader selection of 
sentence 4 is indicated at "X" in FIG. 21, causing the 
sentences to separate at sentence 4 as illustrated in FIG. 22. 

Referring now to FIG. 22, the result of selecting sentence 
4 at 223 is illustrated. Sentence 4 is the sentence currently 
being read. In one embodiment, the completion of reading ^ 
sentence 4 is indicated by the reader activation of a computer 
peripheral device such as a motise button. In another 
embodiment, the completion of reading a sentence is indi- 
cated by the passage of a time period calculated to corre- 
spond to the weight of the sentence and the reader's recent 
reading speed. In a preferred embodiment, the completion of 
sentence reading is switchable between a time based mode 
and a reader actuated mode. In one embodiment, speed is 
reader adjustable using input such as a sliding scroll bar. 
This allows the reader to increase and decrease speed easily 
to suit the passage being read. 

When completion of reading a sentence is indicated, the 
next sentence is advanced into position. In FIG. 22, in one 
embodiment, sentence 4 slides quickly to the left to reveal 
sentence 5 underneath. In another embodiment, sentence 4 40 
and all subsequent sentences in the paragraph slide to the left 
by the width of one vertical margin, with sentence 4 con- 
tinuing to slide left to takes its place underneath sentence 3. 
In this last embodiment, the sentence being read can be 
maintained in the same position by moving the sentence 45 
before the text of the sentence becomes visible to the reader. 
After the last sentence in the paragraph is read, the next 
paragraph is opened to reveal the sentences within, resem- 
bling closely the illustration of FIG. 21, but with the next 
paragraph exposed or pulled down. 50 

In a preferred embodiment of the invention, alternate text 
hierarchies are represented by planes having alternate hori- 
zontal and vertical exposed margins. Stated differently using 
current Microsoft Windows terminology, alternate text hier- 
archies are represented by alternately horizontally and ver- 55 
tically tiled planes. In one embodiment, the outer, higher 
ranked text hierarchies appear to be behind the inner, lower 
ranked text hierarchies, as the opened higher ranked text 
hierarchies have the next lower ranked text hierarchy dis- 
played thereover. In another embodiment, the outer, higher 60 
ranked text hierarchies appear to be closer to the reader, with 
the inner, lower ranked hierarchies displayed further from 
the viewer. In this embodiment, the currently opened text 
hierarchy is preferably not displayed, except for the cur- 
rently being read sentence. In one example tising horizon- 65 
tally tiled text units and having a text unit number 3 opened, 
the text units appear as a deck of cards splayed open, having 
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1 on top of 2 on top of the top edge of 3 and 4 under 3 and 
5 under 4. The xmits toward the top of the screen appear 
closer to the viewer than the units toward the bottom of the 
screen. This is the arrangement used in the embodiment of 
FIG. 22 with respect to paragraphs, but with paragraph 
nxunber 3 opened. 

In another example, text units 1 through 3 are as previ- 
ously described, but text tmit 4 is on top of the lower edge 
of text unit 3, and text unit 5 is on top of all but the upper 
edge of text unit 4. In this arrangement, the text units appear 
to grow further away from the viewer from the outer margins 
until the opened text unit Is displayed, after which the text 
units appear to become closer to the viewer until the 
opposite outer margin reached. This arrangement is similar 
to having a series of nested theater curtains, the outer 
curtains being in front, the more iimer curtains being behind 
the outer curtains, and the more inner curtains revealing a 
smaller aperture than the outer curtains. 

In the general case, the orientation of the margins is varied 
depending on the text hierarchy level represented. While the 
illustrated embodiments have the margins oriented alter- 
nately horizontal and vertical, 90 degrees ofiiset, in the 
general case, the offeet could be less. In one example, the 
highest level hierarchy has horizontal margins (extending 
from 9 O'clock to 3 0' Qock , and the next, lower level is 
oflOset by 30 degrees, extending fi-om 10 O'clock to 4 
O'clock. 

Referring again to FIG. 22, the display of the current 
"book" being read can be explained without reference to 
how the reader came to be reading a particular sentence. The 
next lower text hierarchy is indicated by chapters 206 which 
are horizontally tiled, having horizontal lower margins 204 
exposed. The next lower text hierarchy, pages 210, are 
displayed superimposed over chapters 206, Pages 210 are 
vertically tiled, having vertical margins 212 exposed. The 
next lower text hierarchy, paragraphs 214, are displayed 
over pages 210. Paragraphs 214 are horizontally tUed, 
having horizontal margins 216 exposed. The next lower text 
hierarchy, sentences 218, are vertically tiled, having vertical 
margins 220 exposed. 

The reader is able to visualize the location of the sentence 
being read within the paragraph, the paragraph within the 
page, the page within the chapter, and the chapter within the 
book. Using known three dimensional shading and perspec- 
tive display techniques, e.g. planar edge shading and 
bevelling, nested planar text hierarchies can give the reader 
a three dimensional feel of the location of the text being 
read. 

In one embodiment, the sentences are displayed in hori- 
zontally sliding planes. In another embodiment, the sen- 
tences are displayed in a series of horizontally tiled planes 
that slide horizontally, simOar to paragraphs 214 in FIG. 22. 
In one embodiment, sentences are always set to be displayed 
as cither horizontally or vertically tiled planes, with the 
higher ranked text hierarchies alternating as horizontally and 
vertically tiled planes. 

In some text bodies, there may be a large number of units, 
for example, a very large number of pages in a chapter, or 
a book with no chapters. To deal with this situation, an 
artificial hierarchy can be created. In one embodiment, an 
"Order of Ten" hierarchy can be created. For example, if the 
number of chapters is greater than 50, an artificial unit of "10 
Chapters" can be created. This artificial unit can be created 
as either a higher ranked text hierarchy to be displayed as 
such or simply as a unit of similar rank to be tiled the same 
but displayed differently. In one example, the imit of "10 
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Chapters" is tiled vertically while the chapters are tiled screen or display page at a time, with all lines on the display, 

horizontally. In another example, the units of "10 Chapters" even the most distant lines, being readable. In one 

and chapters are both tUed horizontally, but with the "10 embodiment, the line aaively being read is indicated as 

Chapter" unit having a darker color or otherwise different being brighter or having higher contrast than the lines of text 
appearance. S not having been read. The line actively being read can be 

estimated by advancing a brightening line wide cursor at the 

Text Display Across Opposed Pages rate of the reader's estimated reading speed. In a variation of 

In another aspect of the invention, a method for displaying embodiment, a line wide translucent filter is advanced 

text on subsequent pages is provided. Referring now to FIG. actively read, such that text not being on the 

23, a left page 250 having a right margin 252 is illustrated ^^^S read appears slighdy fuzzy and less readable than 

as is a right page 254 having a left margin 255, obscured by ^® 

right margin 252. Page number 3 is displayed as left page Referring now to FIG. 26, the display of FIG. 25 is 

250 and page number 4 is displayed as right page 254. Page illustrated as a modified display page 290, with the text 

number 3 is indicated as being read by the "X." Upon having been advanced one line forward. First line 282 has 

completion of reading page number 3, this can be indicated been forced forward off the display while second line 284 is 

to the reading system by reader action or by completion of now at the forefront. In this embodiment of the invention, 

a time interval. Upon completion of reading page number 3, text can be advanced a line at a time, toward the reader. With 

indicated by arrow 251, page number 4 is displayed "in front current technology, the text can be made to scroll smoothly 

of page number 3, with right page 254 left margin 255 forward toward the reader. A perspective effect can be 

obscuring left page 250 right margin 252. Upon completion achieved by making the lower text lines with larger fonts and 

of reading page number 6, indicated by arrow 253, new greater interline distances. Three dimensional fonts can also 

pages are displayed, with page number 5 being displayed as be used. In a preferred embodiment, the text is displayed as 

left page 250 and page number 6 being displayed as right enhanced text after processing, using folding methods 

page 254. In this fashion, pages are alternated left and right described above. 

to mimic the familiar pattem of paper books readers are ^ In an alternate embodiment, text is displayed to appear as 

accustomed to. being displayed from front to back when read from bottom 

Referring now to FIG, 24, another embodiment of the lo top, as described above. In this embodiment, the text is 

invention is illustrated. A left page 260 having a right margin displayed statically, one screen at a time, with text being 

262 is illustrated as is a right page 264 having a left margin paged through in multiple line chunks rather than being 

265, obscured by right margin 262, page number 3 is smoothly scrolled through. 

displayed as left page 260 and page number 4 is displayed The embodiments illustrated in FIGS. 25 and 26 take 

as right page 264. Page number 3 is indicated by the "X." advantage of the natural image processing selected for by 

Upon completion of reading page number 3, indicated by human evolution. Specifically, humans, prior to reading, 

arrow 261, page number 4 is brought to the front such that processed information while walking or otherwise moving 

left margin 265 obscures right margin 262. In addition, upon forward, with newer information appearing first as further 

the reading completion of page 3, page number 3 is removed away and moving closer with time and movement through 

and replaced with page number 5. This configuration is not the landscape. English is written from top to bottom to allow 

possible using traditional, paper bindings. Upon completion the writer to read what has been written on the preceding 

of reading page number 4, indicated by arrow 263, page line. Writing from bottom to top would cover up the lines 

number 5 is brought to the front and page number 4 is justwritten with the writer's hand. This aspect is well known 

removed and replaced with page number 6. to left handed writers in a slighUy different form. English is 

The embodiment illustrated in FIG. 24 has the advantage written from left to right, allowing right handed writers to 

of allowing text segments to be broken across pages while see the words they have just written. Left handed writers 
always providing the next page to be read on the screen. This 45 cover up what they have just written, and often assume a 

allows the reader to advance from previously displayed text cramped writing hand position in an attempt to compensate 

without having to wait for new display of text. For example, for this disadvantage. Publishing has heretofore adapted the 

a text segment broken across page number 3 and 4 could be top to bottom style used for hand written text, without 

read by the reader without requiring a pause for the contents having to. The present invention frees text display from the 
ofpage 4 to be displayed. Atext segment broken across page 50 top down convention, allowing display in a more natural, 

numbers 4 and 5 could be read by the reader without albeit unconventional display format, 
requiring a pause for the contents of page 5 to be displayed. 

In essence, the reader is able to read electronically displayed Varying Transition Patterns With Text Levels 

text without having to wait for page flipping, while at the In another aspect of the invention, transition patterns 
same time having the familiar presentation of text on oppos- 55 between text displays is varied as a function of the level or 

ing pages, a throw back to bound, paper books. The middle hierarchy ranking of the text. In one embodiment, the 

configuration of FIG. 24 is not bound by binding. transition between sentences within a paragraph is different 

, i-tij- 1- . than a transition between paragraphs. The transition between 

Text Display for Readmg from Front to Back ^^^^^^^^ ^e varied as a function of the position of the 

Referring now to FIG. 25, another aspect of the invention 60 sentence within the paragraph. The transition between para- 
is illustrated in a screen display of text 280, having a first graphs can be varied as a fimction of the position of the 
text line 282, a second text line 284, a third text line 286, and paragraph within the chapter or other text hierarchy within 
a fourth text line 288. Using perspective illustration which it resides. 

techniques, first line 282 can be made to appear closer to the In one example of the invention, transition between 
reader than second line 284, second line 284 closer than 65 paragraphs is accomplished by dissolving the just displayed 

third line 286, and third line 286 closer than fourth line 288. sentence, before displaying the next sentence. The dissolve 

In one embodiment of the invention, text is displayed one can be a fine grained dissolve for the first paragraph in a 
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chapter, a coarse grained dissolve for the last paragraph in a 
chapter, and a continuum of granularity therebetween for 
intermediately positioned paragraphs. In another example of 
the invention, each successive sentence in a paragraph could 
be displayed starting either al a more rightward position, a 5 
more downward position, or both. In this way, successive 
sentences in a paragraph would march either rightward, 
downward, or both with the progression of the paragraph. 

In another embodiment of the invention, a musical key, 
played by an instrument, is associated with a paragraph to be lO 
displayed. In one example, the same key and instrument is 
associated with every paragraph. A number of notes corre- 
sponding to the number of sentences in the paragraph is 
played down the scale in that key at the start of the display 
of the paragraph. At the beginning of the display of each ^5 
sentence, the corresponding note in the scale is played up or 
down the scale. In a corresponding example, a number of 
notes corresponding to the number or location of that 
sentence is played. In one embodiment, if the sentence 
contained more than one clause, a chord is played. In one 20 
embodiment, if the sentence contained contrasting expres- 
sions such as "despite"* or "however", a minor or discordant 
chord could be played. In one embodiment, a different 
instrument and/or key is used for every paragraph. 

25 

Temporal Protrusion 

In another aspect of the invention, certain words are 
selected to protrude temporally from the other words in the 
sentence. The selected words in one example are displayed 3Q 
before the remaining words in the sentence are displayed. In 
another example, the selected words are displayed after the 
remaining words are no longer displayed. In yet another 
example, the selected words are displayed both prior to the 
remaining words being displayed and after the remaining 35 
words are no longer displayed. The displayed before or after 
the remaining words are beHeved to receive more attention 
from the reader. Words displayed prior to the remaining 
words are believed to register with and partially analyzed by 
the reader prior to the reading of the remainder of the 
sentence, this is believed to make the reader aware of the 
word such that the reader is not caught unaware and having 
to back track. 

In one embodiment, the words are selected based on the 
dif&culty the reader is predicted to have with the selected 45 
words. In one example, words above a certain educational 
level are selected for temporal protrusion. In another 
example, words having a sound-spelling mismatch are 
selected for temporal protrusion, A sound -spelling mismatch 
refers to words whose pronunciation is not deriveable from 50 
the spelhng. In yet another example, a word frequency 
dictionary is used, and words used with low frequency are 
selected for temporal protrusion. 

Prose Painting 55 

In another aspect of the invention, color is used in 
conjtmction with text analysis to display the interrelation- • 
ship of parts of a sentence with another. One embodiment of 
this method can include the steps listed below. 

a. Analyzing the sentence, subdividing the sentence into a 
plurality of text segments based on relationships of said text 
segments to each other. 

b. Organizing said text segments into a tree having a root 
parent node and a plurality of parent nodes and child nodes. 55 

c. Assigning each child node a attribute based on the 
relationship with the parent node. 
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d. Assigning the root node a color. 

e. For each child node beneath the root node, assigning a 
color to each child node based upon the color of the parent 
node modified by the relationship between the child node 
and the parent node. 

f. Repeating step e until all nodes have a color assigned. 

g. Displaying said text in lines in substantially the same 
order specified by the author using the color assigned in the 
tree. 

Referring now to FIG. 27, in one embodiment of the 
above recited algorithm, the parent-child relationships are 
selected from the group consisting of entity, action and 
modification. An original sentence 300 is subdivided into 
three text segments 302, 304, and 306, as indicated by a tree 
301. Text segment 302 has an entity relationship to parent 
300, segment 304 has an action relationship to parent 300, 
and segment 306 has an action relationship to parent 300. 
Parent 300, in a generation 0 at 308 has an initial color triple 
(Red Green Blue) of ROO-GOO-BOO, as indicated in segment 
300. The amount of color added to each generation of child 
segments can be a function of the generation number itself. 
In FIG, 27, 100 units of color are added to a first child 
generation at 310, 50 units of color are added to a second 
generation 312, and 25 units of color are added to a third 
generation 314. The color itself is added as a function of the 
parent-child relationship. In FIG. 27, Blue is added for 
Entities, Red for Actions, and Green for Modifiers. 

In FIG. 27, segment 302 is has an Entity relationship with 
parent 300 and is at the first generation level, so 100 units 
of Blue are added. Hie amount of color added is less at each 
generation. The function of each word in the sentence is thus 
influenced most by the function of the largest segment of 
which it is a part. 

New Qualities Imparted by the Prose Paint Process 
Speech is a communication system in which individual 
uttered units, such as words, have discrete meanings, and a 
larger meaning is constructed by the relationships among a 
group of words. The sequence of words is important struc- 
tural information that is used to build the meaning of the 
relationships among the words. Within sequences of words, 
smaller sequences of words have special relationships 
among them. In this way, the order of two or more smaller 
sequences of words within a larger sequence of words is also 
a form of structural information that is used to build the 
meaning of the relationships among all the words. 

In addition to selecting the order in which words are 
uttered, a speaker also pronounces each word, or group of 
words, with certain sound attributes that are in addition to 
the simple pronunciation of the phonemes that indicate what 
the word is. Hiese additional sound attributes include the 
pitch, volume and timbre with which the words are spoken. 
These sound attributes commute and combine in that a 
particular word within a phrase will be modified relative to 
what these additional soxmd attributes are for the phrase as 
a whole. 

These additional pronunciation attributes, such as pitch, 
voltmie and timbre, (hereinafter referred to as intonational 
attributes) therefore represent a multi dimensional system of 
values that can be combined and which commute across 
successive levels of differentiation of word groups into 
smaller sub-units within the larger word groups. These 
values represent the relationship of the word (or words) to 
the larger unit of the group of words it was a part of. 

In addition, each sub unit is kept within a range of 
intonational values that is appropriate for its immediate 
context. A larger unit, which may contain several sub-units 
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of its own, similarly will relate to the yet larger unit with visual attributes that are similar to the intonational 

containing sub units like itself, with a change in one these attributes of speech. These visual attributes should create a 

same intonational values that is appropriate for this larger multi-dimensional system of combinable and commutable 

context. values that represent attributes of the words in addition to 

For example, a careful audition of the sentence: "The 5 their word-specific meanings. These visual attributes should 

purple hat of the purple clown was put into a purple also be transparent, i.e., perceivable simultaneously with the 

box."-will discern that the intonational values of each of the perception of the words themselves, 

words "purple" appropriately set the word "purple" apart, in Moreover, unless a text presentation method systemati- 

a tonal way, from the larger units the word "purple" is cally assures that the author-specified sequence of words is 
modifying in each case. In the first case, "The (purple) hat", lo unambiguously represented, it is not text presentation as 

is the principle entity of the sentence as a whole: the meant in this discussion, but simply a method to demonstrate 

intonational value of "purple" in this case is built up from a the results of some narrow aspect of text analysis which 

baseline set of values used to represent the principle entity. subordinates the integrity of the author's message to the 

In the second case, the phrase "of the (purple) clown", objectives of such an analysis, 

itself is a segment that has a modifying relationship to the The "Prose Paint" process described above uniquely 

entire subject phrase. This second "purple" therefore has a represents these intonational conditions of speech in an 

lower volume than the first "purple" but still has a pitch that unambiguous text presentation. In addition, the "Prose 

sets it apart, in a tonal way, firom "clown", in the same way Paint" process is a novel approach to syntactic analysis 

that the first "purple" set itself apart from "hat". itself, in. that the properties of entity, action, and 

In the third case, the entire phrase "was put into a purple modification, which represent the relationships between 

box" — is varied in a different tonal dimension, (the timbre is child and parent segments, also combine and commute 

sharper), to set it apart from the first half of the sentence, as across successive levels of differentiation of a sentence, 

a way of depicting that this segment is in an "action" in other words, it is not only that enhanced visual pre- 

dimension relative to the sentence. The sub-units of this sentation of text should aspire to the conditions of speech, 

phrase retain this baseline timbre dimension value, and then but that syntactic analysis itself should aspire to the condi- 

modify it by changing the intonational values of each sub tions of intonality. Abasic exercise for testing grammar rules 

unit based on the relationship of the sub-unit to the larger in linguistic analysis is to create a series of words using the 

segment they were a part of In this way, the third "purple" grammar rules and then to listen to the proposed sentence to 

stiU has, in the sinaUer context of its relationship to "the determine if it "soxmds right". It is possible, as illustrated by 

(purple) box", a pitch that sets it tonally apart from '1)ox", the previous discussion on intonational values, that the inner 

but it also carries a slightly sharper timbre than the first two "reasoning" by which "complete sentences" are intuitively 

"purple"s because it is also in the "action" dimension as a recognized as vatid propositions is mediated by a multi 

part of "was put into a (purple) box." dimensional system of attributes for the relationships of sub 

To further illustrate this intonational structure, notice how units to larger units whose outward expression is intonality. 

the word "hat" has two different sets of intonational values Hie mathematics of the mind may be musical, 

in the following sentence: "The purple hat of the purple The method can be used to display text using either the 

clown was put into the hat box " The second "hat" in this text folding described previously or using standard text 

sentence has a set of mtonational values that denote its displays, but in color. The method can also stop short of 

modifying properties for an entity ("box", the object) of the segmenting a sentence into words. For example, the algo- 

action segment ("was put into") of the sentence. In contrast, rithm can stop after a fixed number of levels, or leave 

the first "hat" has a set of intonational values that place it as phrases intact, leaving all words in the phrase with the same 

the principle entity of the sentence as a whole. The second color. 

"hat" in this second example sentence actually has a set of wt u * • j j * £*i. ■ 

, , J , f , . • 1 . . .1 1. , Numerous characteristics and advantages of the mvention 

pitch, tone and volume values that is equivalent to the thu-d j u *u- j * l i. . c • r 
„ \ „ . e , 1 , ^ 45 covered by this document have been set forth m the forgoing 

"purple m the first example sentence. r* n u ^ * a u *u * *u- j- i 

\^ . . description. It will be understood, however, that this disclo- 

-niese dimensions of intonaUty in speech, as stated above, g^rc is, in many respects, only iUustrative. Changes may be 

have combinable and commutable values. These dimensions ^ade in details, particularly in matters of combining, 

of mtonality are also transparent in that they are perceived separating, and arranging steps, without exceeding the scope 
simultaneously with the word unit that is carrying the 50 of this invention. The invention's scope is, of course, defined 

individual word meaning information: each spoken word is ^ language in which the appended claims are expressed, 

therefore carrying a packet of both semantic and syntactic What is claimed is: 

information. In this way, the dimensions of intonality are 1^ ^ metiiod for displaying text including words, phrases, 

non annotative; that is, they do not require additional utter- and sentences to produce a text display comprising: 

ance. A person does not, for example, say before each phrase « . • j r j . . 1 j . • 

^ «c»K:*^t A'd f iS * 4- having a reader-performer read the text aloud, whe rem 

of a sentence. Subject-the purple hat modifier of subject-of j S «r ^ 1 . ^ 

tu^ , . ♦ • * u- 4 *u 1 u « said reader-performer performs actions are selected 

the purple clown-verb-was put into-object-the purple box. c i- 

-5 , , , . . . *he group consisting of speaking, hand 
However, the existmg methods of representing the rela- movement, eye movement, head movement, and mouth 
tionships between groups of words in a sentence, such as movement- 
parse trees or grammatical diagrams, are not transparent, but 60 1 4 • 1/ J' -J r 
instead rely on additional annotation and symbols to label electronically recording said actions of said reader- 
tiie word groups. Tliese labels, in turn, are fixed and do not . performer correspondmg to said text; 
coinbine or commute values across successive levels of displaying said text; 

sub-imit differentiation, or Limit such values according to varying said text display in accordance with said reader- 

their context 65 performer actions; 

It is therefore desirable that enhanced text presentation wherein said actions are recorded and said text display is 

should enrich the appearance of the actual words of the text varied in accordance with said actions; and 
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wherein said spoken speech attributes are selected from 
the group consisting of pitch, tone, volume, and pauses 
between words. 

2. A method for displaying text as recited in claim 1 
wherein said wherein said text display has display attributes 
varied in accordance with said spoken speech attributes and 
said display attributes are selected &om the group consisting 
of font, intensity, font line thickness, font character height, 
inter-character spacing, inter-word spacing, inter line spac- 
ing and inter-sentence spacing. 

3. A method for displaying text as recited in claim 1 
wherein said hand gestures are recorded and said text 
display is varied in accordance with said hand gestures. 

4. A method for displaying text as recited in claim 3 
wherein said hand gestures include hand position and ori- 
entation and finger position and orientation. 

5. A method for displaying text as recited in claim 3 
wherein said text display includes modifying the horizontal 
displacement of said text as a function of the horizontal 
displacement of said hands and said text display includes 
modifying the vertical displacement as a function of said 
hand vertical displacement. 

6. A method for displaying as recited in claim wherein 
said facial gestures are recorded and said text is displayed in 
accordance with said facial gestures. 

7. A method for displaying text as recited in claim 6 
wherein said recorded facial gestm^es are selected from the 
group consisting of eye shape, eye openness, eyebrow 
position, and mouth shape. 

8. A method for displaying text having an original 
sequence comprising: 

segmenting said text into a plurality of segments; and 
displaying said segments on a plurality of lines, 
wherein reading said text from bottom to top substantially 

reserves said original sequence, 
wherein said text is displayed in a perspective view such 
hat text segments above other segments appear to be 
further away from the reader, such that in reading said 
text from bottom to top said text appears to be reading 
from front to back; and 
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further comprising placing a partially translucent virtual 
lens over text above the lower line being read, such that 
text above said lower line is visible but less easily read 
then the text below the line. 
5 9. A method for displaying text having an original 
sequence comprising: 
segmenting said text into a plurality of segments; and 
displaying said segments on a plurahty of lines, 
10 wherein reading said text from bottom to top substantially 
preserves said original sequence, 
wherein said text is displayed in a perspective view such 
that text segments above other segments appear to be 
further away from the reader, such that in reading said 
text from bottom to top said text appears to be reading 
from front to back; and 
wherein the text above said certain Hne is less bright than 
the text line being read. 
20 10. A method or displaying text having an original 
sequence comprising: 

segmenting said text into a plurality of segments; and 
displaying said segments on a plurahty of hues, 
wherein reading said text from bottom to top substantially 
^ preserves said original sequence, 

wherein said text is displayed in a perspective view such 
that text segments above other segments appear to be 
further away from the reader, such that in reading said 
text from bottom to top said text appears to be reading 
from front to back; and 
wherein said text in a line being read is removed after 
indicated as read and a line of text immediately behind 
said line being read is displayed to appear closer to the 
35 reader, such that the reader appears to be moving 
forward through the text being read. 
11. A method as recited in claims 8, 9, and 10 wherein said 
text is displayed in a font decreasing in size from bottom 
lines to top hnes of text. 

4c « 3»C « 9^ 
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